What spoils the speaker’s “ghostliness”?

John's lack of respect for the narrator's feelings spoils the speaker's ghostliness.

“That spoils my ghostliness, I am afraid, but I don't care—there is something strange about the house—I can feel it. I even said so to John one moonlight evening, but he said what I felt was a “DRAUGHT,” and shut the window”