What causes one of the listeners on the Nellie to say "Try to be civil..."?

Marlow is lamenting about something watching him. He ruminates about how the sailors are being watched by the company for a paltry amount of money. Someone hears this and asks Marlow to "Try to be civil.".