Why does Magwitch insist that Herbert swear on a Bible? What does this reveal about Magwitch?

Magwitch may be a thief and a convict, but ironically he trusts and believes that the truth comes from those willing to swear on the Bible. He's got a bit of religion after all!