Instead of worrying about what people say of you, why not spend time trying to accomplish something they will admire.
“They say that our sovereign is above his laws to his pleasure, and he may make it and break it as he pleases, without any distinction. The contrary is true, or else he should not have sworn to keep it.”