We all have emotional baggage. That's probably what separates us out from the saints and holymen and women.
Emotions are thought forms held in the mind-body at the subconscious level which surface when the right stimulus is provided. The more we carry, the more easily we are triggered to react.
Accept that you - the real you - are not the emotions. Not easy, but can be done. I recommend a ten-day course in a Vipassana Meditation centre, or some other really serious meditational retreat (not the feel-good relaxation type, but the ones that will take you deep within so you can find out what you are not) Once you're fully established in the realization that there is a real you and self-image you (the ego) you'll be on your way to freeing yourself from you own baggage. And once you've done that, other people's baggage will concern you far less.