you can make it as fancy as you want i went to a brunch wedding that was very fancy and it seemed disjointed with the time of day just be aware that people are going to drink less and might dance less doesnt mean that they will not have a great time but i doubt a black tie even will go over very well at lunch so as long as an afternoon wedding matches your vision you will be fine