Answer
A breeze blowing on bare skin reduces or removes this protective thermal blanket. In principle, on a hot day this would result in your skin feeling hotter, but this effect is overshadowed by the cooling effect of the breeze (due to evaporation of sweat).
On a cold day, when the thermal blanket of air is removed, your skin loses heat more quickly to the cool air, and your skin feels colder.
