'Haunted by the past' is a commonplace phrase because it's a commonplace experience. Even if one is not, strictly speaking, 'haunted', the past is perpetually with one in the present, and the longer it grows and the further it recedes the stronger its presence seems to become.
Philip RothI think you're a wonder. You're beautiful. You're mature. You are, I admit, vastly more experienced than I am. That's what threw me. I was thrown. Forgive me.
Philip RothA life of writing books is a trying adventure in which you cannot find out where you are unless you lose your way.
Philip RothEverybody who flashed the signs of loyalty he took to be loyal. Everybody who flashed the signs of intelligence he took to be intelligent. And so he had failed to see into his daughter, failed to see into his wife, failed to see into his one and only mistressโprobably had never even begun to see into himself
Philip Roth