It's a completely subjective experience depending upon the person/situation you think you should walk away from.
Although if you reach a point where you feel like you should be walking away, ensure it is the right thing to do. If it's a person, speak to them calmly about your problems. If it's a situation, enlist other people's opinions if you're stuck.
Ultimately though, the choice is always yours. I hope this helps in some way