Why didn't the narrator kill the old man during those night??

He usually found the eye closed at night when the old man was sleeping,

...but I found the eye always closed; and so it was impossible to do the work;; for it was not the old man who vexed me, but his Evil Eye.