The Question and Answer section for Ethan Frome is a great resource to ask questions, find answers, and discuss the novel.
From the text:
It was there that, several years ago, I saw him for the first time; and the sight pulled me up sharp. Even then he was the most striking figure in Starkfield, though he was but the ruin of a man. It was not so much his great height...
There is certainly an emptiness that haunts the novel. Ethan's life is emotionally empty and we see this manifested in the gloomy grey imagery of the novel. "Starkfield" personifies Ethan's sense of loneliness and isolation.