Why did the narrator feel there was some secret knowledge about town life that he did not have ?

The narrator simply feels like a "fish out of water" living in town,

“I never felt as though I understood how town life worked. I thought there was some secret knowledge about living comfortably and unself-consciously in a community and I was sure that I did not possess that knowledge.”