Why does marley say he suffers most at the time of the rolling year?

This is because he remembers walking through crowds with his "eyes turned down" not noticing the holy star. He wonders why he did not take notice of the lights of the poor which could have lead him to salvation.