Our swing and bouncy chair was free. I used one for both my boys and they loved it. Ours is next to my treadmill so I am hoping that as I am walking the baby can be right there and happy. We have gotten everything used off Kijiji. Our playpen is new, only used once and is obviously new. We got that for $50. Got the crib from a set of grandparents that only needed it for a short time so that is like new condition too for only $60. We got tons of other furniture too (Basinet, stroller and so on) all for way less then the price of new. Luckliy I know what I will likely use and not use.
We did buy some things new, like a few blankets, 2 outfits one of which is a sleeper, the safety kit, ear thermometer and so on. But waited till sales to get them. Being experienced does help in knowing what you will most likely use and need.