Life is all about hardship, But what doesn't kill you will only make you stronger.
Do not see the past in your new boyfriend. Look only towards the future, and see if he is the right man for you. Remember that each individual is unique.
When he says something like "either you trust him or you don't" he is trying to ascertain his power of you. In a healthy relationship, a man and a woman must be able to love and hold control over each other (that's why relationships last over 20,30,40,50+ years)
It is entirely up to you whether you trust him or you don't, it depends on your better judgement.
I say, if you show unconditional love, and he shows it right back, then there should be no problems. If he doesn't, then its up to you if you want to continue the relationship.