When you argue with your inferiors, you convince them of only one thing: they are as clever as you.
I agree that it is not just the extremists who harbor bad thoughts or engage in bad acts, but they are usually the source of the polarization and try to keep education and communication of the main stream from moving forward.