what does it mean when hiram say s"what they had in common is what kept them apart"?

Both Hiram and his father were stubborn and passionate of their opposing view of the South. They both shared and intellect and attitude that kept them apart.