Why was Ignosi angry at the adventurers?

Ignosi believes that Quatermain and the others value the diamonds more than his friendship. He doesn't understand why they want to go home and declares that he and his people will never again welcome a white man in Kukuanaland. Future visitors will be required to leave or die.