Ignore people and their useless advice. Both my parents worked when they had my sister and I and we turned out just fine (although that may be up for debate at times
We are both well adjusted, contributing members of society and I don't have any ill will toward my parents because they chose to work and make a happy life for the family.
Bottom line is to do what YOU feel is best for not only baby and family, but for yourself too! I'll return to work after we have the twins, but only very part-time. Being Canadian we get a substantial paid maternity leave (1 year at 55%, but my employer tops us up to 84%) so I won't be returning to work until after my mat leave is up. All that being said, I hate my job so taking a year off is definately the right thing for me!
I don't listen to people's unsolicited advice anymore. I didn't regarding the wedding and certainly won't regarding the kids! Whatever decision you make will be the right one for you and the fam! Everyone else can suck it!