Why do the men “soften up” and stop cursing Jim?

The doctor tells the men about Jim's exemplary behaviour while he was with him. The doctor explains that Jim stepped out of hiding when Tom became seriously ill. He helped the doctor when Tom became delusional and violent.