Robert Frost: Poems

what is frost implying when he says that his neighbour "moves in darkness as it seems to me /not of woods only and the shade of trees"? what might darkness symbolise/represent in this poem