Why do the voices disappear in part 6

The voices leave because, like the Wedding Guest, they have somewhere to be; the second voice urges the first: "Fly, brother, fly! More high, more high! / Or we shall be belated." Yet unlike the Wedding Guest, the voices are not riveted by the Ancient Mariner's tale and can continue on to their destination after briefly stopping to consider him.