What is curious about Beatty’s past as evidenced by comments he makes to Montag?

Captain Beatty can recite famous works from literature even though his job is to destroy literature. This makes us wonder how he learned and memorized these works in a society that has forbid reading these works.