I have irrational fears, and they all go back to losing my father as a kid. I've never gotten over it.
There's people that are just in awe of what you do, and then there are people who just think it's garbage. And I think there are people who are just uncomfortable seeing someone have fun with their job.
There's something to be said in favor of working in isolation in the real world.