How does the world outside the town react to the veil?

Hooper was conscious of the fear his veil instilled in the townspeople. It hurt him when children ran from him, and when rumors surfaced of a terrible crime he was hiding. He as “irreproachable in outward act, yet shrouded in dismal suspicious; kind and loving, though unloved and dimly feared; a man apart from men, shunned in their health and joy, but ever summon to their aid in mortal anguish.”