Why does Hester hate Chillingworth?

Hester never loved Chillingworth in the first place. He was old and not a nice man. Hester was young and vibrant and kind. Chillingworth is now using Hester so he can torture Dimmesdale. His motives are twisted. He has no real interest in Hester or Pearl.