Yes, some people say to me you're too skinny, but never a skinny person says that to me, only people who could lose a few pounds say that.
I find the selectivity of erotic love - the choice of this man or this woman - much more intelligible if liking the person is the origin of sexual interest, rather than the other way.