Drop him and move on.
Give him nothing else. No more of your attention, emotions, anything. Yes, this includes anger, sadness, etc. Allowing him to manipulate your emotions is giving him power over your mind and heart. He doesn't deserve it.
Part with him and find someone who deserves your love and attention and that you can feel comfortable and safe with. Talk out your feeling with some friends and remove any reminders of him (within reason - i.e. don't burn your house down or anything LOL) so that you don't feel over it, and then see a picture of you two together and then get mad/sad all over again.