Why should Hester's marriage be a failure?

Hester's husband sent her to America alone and unchaperoned. He never came to claim her, and he never sent word about his own circumstances. In the meantime, Hester fell in love, commited adultery, and had a child out of wedlock. Chillingworth not only would never have claimed her as his wife, he didn't even want anyone to know they were acquainted.