I hope you don't believe the adage, because I'm going to answer with an unqualified "No."
Often, it's the people who start out in tough circumstances that learn how to work hard and learn their strengths and weaknesses. Then, when things get better, they are ready to rocket to the top, like a company that has just restructured in a recession and finds itself newly profitable (like GM or Ford did).
It all depends how you define success. In my opinion, someone who starts out with millions of dollars and ends up with the same has not achieved any success whatsoever. In fact, I think that person is to be pitied, as they have no idea what it is like to struggle and fail, then learn from their mistakes and return to win.