Why might too many winters have such a powerful negative effect?

Harmon's mention of too many winters was directly related to Ethan's physical appearance. Our narrator describes him in the following way;

"He looks as if he was dead and in hell now!"