What does it mean in Maycomb when grown men stand outside in the front yard instead of coming into the house?

It says that these men knew that they were in the wrong and embarrassed that they were threatening to Atticus. The men merely follow their bigoted habits without really considering the situation.