Hi there. From what you have said, I believe you are the victim of an abusive partner, although whether or not he is being purposefully abusive would be a hard thing to determine, even for a proffessional. Try speaking to him about it and point out that, whether or not it is intentional, his behaviour is causing you a great deal of emotional distress and is unacceptable. He can get help if he wishes to change his behavior, but he must take responsibility for his actions and be the one to decide to change. You also need to seek some proffessional guidance (for your own well being and that of your child). Hopefully it will be a journey of emotional growth that you and your partner embark on together, but if he cannot take responsibility for his behavior and chooses not to seek help, then you need to embark on that journey alone.
Please read my articles on my hub, especially "Emotional Abuse - A Silent Killer", and "The Fine Art of Institutional Grooming". The first will help you to recognise any abuse that is being perpetrated against you, and hopefully inspire you to make the decisions you need to make. The second will help you to recognise the signs if, in the future, things get worse and he continues to be abusive to you and/or starts to manipulate your friends/family, his friends/family, and the system. It will also hopefully reinforce the importance of your decision to change .
The best advice I can give you is KEEP A DIARY. Even if you only make brief notes of any incidents, conversations or fights, so you always have a clear memory of things as time goes by. It will help keep you sane. Personally, I would suggest you do not tell him about it, and I would keep it in a safe place.
On a more positive note, things can get better, you just have to choose to make them better. It will be a hard decision to make and the journey just as difficult, but more than worth the effort. The best thing for your child is not staying in a difficult relationship "for the child's sake", it is doing whatever is best for YOU. Your baby will thrive under the nurturing guidance of a happy, functional mum. Help is available, you just have to find it and then ask for it!
Please read my other hubs for inspiration and enlightenment.
Let your light shine, stay positive and good luck. I hope your situation improves.