What effect does Dimmesdale’s vigil have on his career?

From the text:

The crowd was in a tumult. The men of rank and dignity, who stood more immediately around the clergyman, were so taken by surprise, and so perplexed as to the purport of what they saw--unable to receive the explanation which most readily presented itself, or to imagine any other--that they remained silent and inactive spectators of the judgement which Providence seemed about to work. They beheld the minister, leaning on Hester's shoulder, and supported by her arm around him, approach the scaffold, and ascend its steps; while still the little hand of the sin-born child was clasped in his. Old Roger Chillingworth followed, as one intimately connected with the drama of guilt and sorrow in which they had all been actor