Hmmm...that's a really good question. You'd probably be ok either way but I think that I probably wouldn't send an invitation to ppl who RSVP'd no UNLESS they were a really close friend of mine and I still planned to invite them to other wedding-related events like showers or bachelorette parties. If it's someone very close to you, they might still enjoy getting the invite and feeling included.