What are Chillingsworth's sins and what do they to him?

Chillingworth is Hester's first husband. I suppose his sin started by marrying a woman that really didn't want to marry him. Chillingworth doesn't really become a full blown slimeball until he forges his unhealthy control over Dimmesdale. He seems to care more about torturing this man even more than any feelings he may have for his wife. His motives are not all together coherent. He's kind of like Iago I'm Othello. He feeds off of misery. He poisons Dimmesdale, plays with his mind and enjoys the priest's sufferings. At the same time he cares nothing for Hester except to see her suffer as well.