Answer
Wood and air are poor conductors of heat.
Work Step by Step
Wood is a poor conductor of heat. Air is also a poor conductor of heat.
While there is enough unburnt wood and air between the flame and your fingers, heat will not be transferred to them.
(With no heat transferred to your fingers, the temperature of the skin does not rise.)