What question does Holden ask the cab driver that makes the cab driver stop talking to him?

Holden asks where the ducks go in the winter. The driver does not, however, stop talking. They go around in circles about ducks and fish for the remainder of the ride.