I would definately not do a mass invite. And if you don't want to exclude anyone I wouldn't invite any of them. I don't like the idea of not inviting people to the dinner but to the wedding, personally I would feel awkward. I would just tell them, you are having a small intimate wedding with just family and a few close friends. They should understand.