As a father now, I wouldn't do what my dad did, because it left me feeling emotionally unstable as a kid. But he didn't do the things he did out of selfishness or malice.
Medical physicists work in cooperation with doctors. A few medical physicists devote their time to research and teaching. A few get involved with administrative duties.