You are not crazy at all! We got married in the gardens, our resort was beautiful, the beach was amazing, but we chose the gardens for the ceremony.
There were a bunch of reasons we chose garden over beach - the beach would be windy, our guests wouldn't be able to hear anything that was said, chairs would not be set up on the beach for our 45 guests, we wouldn't be able to have music on the beach (no speakers or cords or a mic) plus you cannot control the beachgoers and gawkers, the gross men in speedos walking into the line of sight for photos or anyone swimming behind you.
The garden was much easier to control the people watching, it was quiet, shady, semi private, we had chairs and more decorations than the beach offerred, we had our own music, and even though we were told we would have a mic for our vows, we didn't. But the gardens were perfect and beautiful and just what we wanted, we are very happy with our pictures. Plus, you can go to the beach after and take pictures, so you get the best of both worlds!
Hope this helps you! If you'd like to see some pics, PM me and I'll happily send some