Why does Dickens compare Darney's fellow prisoners to ghost? (Book 3 Chapters 1-7)

That is because they don't really live. They simply exist alone. They are removed from the population and are visible to only each other. Sometimes they are in solitary and barely exist to themselves. .