An update:
Well he decided to come over anyways. I didn't want to talk in my house so we talked in the park beside it. Which had nothing to do with the baby. He just wanted to tell me in person I guess (apparently the phone and e-mail wasn't enough) that he can't do this anymore and doesn't want any part in anything. I listened to him rant and be upset, he asked if he could feel my stomach, I said sure. Then when I thought I'd keep it together I broke down when he was about to leave. He said "Good-bye Paige" and walked away without looking back.
/sighs
You know, I think I'll always love him in some way or another, but when he walked away I got what he was saying. I fell out of love with him in that moment. I care about him so much and want nothing but the best for him but the magic is gone.