Everything shapes you to be the person you are today. Sometimes hard lessons pay off dividends.
As an actress, you're already disregarded for a lot of the parts by the people who are setting up those shows. You don't need your agent to be doing the same.
Politics, like theater, is one of those things where you've got to be wise enough to know when to leave.