I'm a Cancerian, the typical crab with the tough outer shell and the soft bit in the middle. I don't think I'll ever come to terms with people being unnecessarily nasty, but I can take it if someone doesn't like my music - I'm not everyone's cup of tea.
If the work is pure then you have to think it could be understood. If it is not understood it doesn't mean that your work is not accessible. It doesn't worry me, but, of course, I would be pleased if people liked my work.