It's never been an issue for me - I don't want to go on a diet, I don't want to eat a Caesar salad with no dressing, why would I do that? I ain't got time for this, just be happy and don't be stupid. If I've got a boyfriend and he loves my body then I'm not worried.
I think one of the reasons people quit is because they're afraid they won't be able to get better and better; that they have to come to a zenith of some kind.