The scarlet letter which Hester wears is focus for considerate public attention. Why is this focus ironic?

The townspeople are to a large extent secretly jealous that Hester has experienced passion and love. Many of them harbour these same desires yet judge Hester for something they might have done in secret or wish they had done in their lives.