Again, given the use of physiognomy in literature, what is Hawthrone suggesting by Chillingworth's age, deformed appearance?

I suppose he is suggesting that Hester's union with Chillingworth was done under Hester's duress. Over the years Chillingworth has mutated into something darker than he was before.