If the work is pure then you have to think it could be understood. If it is not understood it doesn't mean that your work is not accessible. It doesn't worry me, but, of course, I would be pleased if people liked my work.
Remember, this was a world that was still ethnically separated. I was thirteen and ignorant of the social situation in America, but I felt these records were better than what my own culture was turning out.