What do Dimmesdale and Chillingworth share, other than Hester herself?

Both Dimmesdale and Chillingworth conceal their relationships to the adulterous act, leaving Hester as the only person to take public responsibility for the affair. They continue to maintain prominent roles in society. Both men are ultimately destroyed by this secrecy as they become entangled in a parasitic relationship.