I don't know if it's harder but when you're playing a real person you want to honor their memory - even if they're a criminal or someone that the public loathed. That can be challenging.
You speak of Lord Byron and me; there is this great difference between us. He describes what he sees I describe what I imagine. Mine is the hardest task.