Answer
Convection outside the window, caused by wind, keeps the air against it colder than if the air were still.
Work Step by Step
Heat conducts through the window to the outside air, warming a thin layer of air outside. When the wind blows, convection continuously exchanges that warmer air for cold air. This increases the temperature difference across the pane, increasing the rate of heat conduction, and making the window feel colder.