Why did the family have to leave the camp so rapidly?

Tom had gone for a walk and met Casey and some other men hiding out. They explained to Tom that they were trying to form a union. The camp security tracks them down and there is a fight. Casey is killed and Tom is now wanted. The family leaves as quickly as they can smuggling Tom out of the camp. If caught Tom would be breaking his parole by leaving the state on top of being involved in the fight at the camp.