Does Dimmesdale really have a scarlet letter inscribed on his cheast or was it mere imagination?

Dimmesdale has a scar on his chest (possibly inflicted by means of self-mutilation) that most people said resembled the Scarlet A worn by Hester.