Dont get upset! Who cares who comes. I understand the need to share this day with everyone; however, it only matters if you two are happy and get married. My FI and I decided that no matter who could come or not (barring parents, of course) we were going to get what we wanted, even if it meant that we were standing there alone. Its your day... so do whatever makes you happy!
Best of luck!!!