I would not stress about this. if your guests can't afford the meal out then they probably just would not attend. I think if it was a rehearsal dinner, then yes it would be tacky to have guests pay. Otherwise, i doubt your guests will care if they have to pay for their own meal.