Why does Jim put off going to see Antonia every time he passes though Nebraska?

I don't think Jim expected Antonia to be doing so well. He expected her to be worn down, old and dejected. He thought it would be difficult to face this visiting her again. He finds out the situation is quite the contrary.