Why do you think Willy was hunted by the memory of his brother Ben?

Haunted? He was haunted because he was supposed to join his brother in Alaska, and his brother became rich after discovering a diamond mine. Needless to say, his brother became rich, and he continued to struggle. That's enough to haunt anyone.