What is ment by the line "that's how it goes and goes"(28)

Esperanza means that they feel safe as long as they are with the familiar: brown Latino's. Around any other race, they become very uncomfortable because, "that's how it goes". 

"All around brown, we are safe. But watch us drive into a neighborhood of another color and our knees go shakity-shake and our car windows get rolled up tight and our eyes look straight. Yeah. That's how it goes."