What is ironic about Dimmesdale's incredible success as a minister?

Inside he torments himself for the sins that he condemns so passionately in his services. As he torments himself and gets sicker, people think it is a martyr sort of thing bringing him closer to God.