The Great Gatsby, we went down the road

I'd like to know if "we went down the road" in the following excerpt from the chapter Five from The Great Gatsby means "we went to / as far as the road" or rather "we followed the road":

Instead of taking the short cut along the Sound we went down the road and entered by the big postern.

Thank you.