When actors get pigeonholed, that's their own doing to a large degree. Because if you do something that people like, obviously they're going to ask you to do it again. It's up to you to say no. If you're that insecure about working, you'll probably do what you're known to do.
“A very wise author once said that a writer writes for himself, and then publishes for money. I write for myself and publish just for the reader.”