If the work is pure then you have to think it could be understood. If it is not understood it doesn't mean that your work is not accessible. It doesn't worry me, but, of course, I would be pleased if people liked my work.
“The school-room sends men to the Legislature, to the bench, and the executive office. The bar-room sends them to the scaffold and hell.”
“Good cinema is what we can believe, and bad cinema is what we can't believe.”