Why do Crooks act aloof? ( In chapter 4 )

Crooks is not allowed in the bunkhouse because he is black. Although he is desperately lonely, he feels like he needs to act aloof in order keep a little self-respect. He initially doesn't want Lennie to come into his small room because it is the only space he has to call his own.