What does he “want” to in public? Why doesn’t he?

Dimmesdale wants to confess his sins beside the woman he loves and his child. He doesn't at that point because most people are asleep and he needs just a little more courage to do it in public.