A lot of poets too live on the margins of social acceptance, they certainly aren't in it for the money. William Blake - only his first book was legitimately published.
I don't play the traditional Charlie Parker songs. But I do improvise and I do create with my instrument, and that to me is jazz. But there are people who use the word 'jazz' only in a traditional sense, and they would be offended by that, and that's fine.