Answer
Metal has greater thermal conductivity than wood.
Work Step by Step
Room temperature is generally lower than your body temperature.
So, both the wood and metal have lower temperature than your skin.
When in contact, heat is going to be transferred from your skin to either object.
As a result, your skin will experience a drop in temperature (it is giving heat away).
Metals have greater thermal conductivity than wood, so more heat will be passed when you touch metal. With more heat passed, your skin becomes cooler.