I think one of the reasons people quit is because they're afraid they won't be able to get better and better; that they have to come to a zenith of some kind.
“Investment banking has, in recent years, resembled a casino, and the massive scale of gambling losses has dragged down traditional business and retail lending activities as banks try to rebuild their balance sheets. This was one aspect of modern financial liberalisation that had dire consequences.”