Why does Grant go to the Rainbow Club after his solo visit with Jefferson?

Grant has only been at the prison for thirty minutes, but not wanting the guards to infer that Jefferson is misbehaving, he stays for the rest of the hour and then leaves. He is tired and frustrated. He really does not want to face Miss. Emma and tell her how Jefferson is acting. Rather than returning to the quarter, Grant heads for the Rainbow Club.