You can't take people's opinions personally. Usually what people say about it is a reflection of them own issues.
“I am perfectly conscious that this contempt and hatred underlies the general tone of the community towards us, and yet when I even remotely hint at the fact that we are not a favorite people I am accused of stirring up strife and setting barriers between the two sects.”