How did Jekyll feel about his behavior as Hyde?

In his letter, Jekyll clearly states that he felt no guilt about Hyde's actions, as "Henry Jekyll stood at times aghast before the acts of Edward Hyde, but the situation was apart from ordinary laws, and insidiously relaxed the grasp of conscience. It was Hyde, after all, and Hyde alone, that was guilty." To the reader, this explanation seems ridiculous, because Hyde is in fact part of Jekyll, and a being that Jekyll created. Therefore, clearly Jekyll is responsible for the man's actions.