Why did Rainsford keep a knife?

Zaroff supplied Rainsford with a knife before the hunt. Rainsford would need the knife to play the forced game of his adversary.

Then a businesslike air animated him. "Ivan," he said to Rainsford, "will supply you with hunting clothes, food, a knife. I suggest you wear moccasins; they leave a poorer trail.