No matter what your choices are, you truly have no control about what people think of you.
I don't listen to music when I write, but I do turn on appropriate music when I read portions of my manuscripts back to myself - kind of like adding a soundtrack to help shape mood.