I think you should do what you want to do. If you want an adults only, then stick with it. It's impossible to make everyone happy. If you change your course due to every complaint you will end up with a wedding that doesn't make you happy.
Good luck!