What two groups of men did Richard see when he and his mother and aunt returned to Granny's house?

Richard sees two very different gangs of men. One gang is made up of a group of soldeirs, the other, is a gang of convicts that together make up a chain gang.