why doesnt zaroff kill rainsfordwhen he him in the tree on the first night?

I believe Zaroff walked away from the tree with a smile that first night because he'd adeptly proven what Rainsford had thought was impossible. He had tracked him. For Zaroff, it's all about the hunt, and he wants a real hunt. Thus, walking away and allowing Rainsford to live began the game in earnest.