What are the man's main concerns, other than avoiding other people? Why?

The man's only real concern is keeping the boy safe and alive. Everything else becomes a threat. People, the weather, lack of food...all become threats to the boy's survival.