That is a good call I often get windburn as well - even in summer from having a desk fan blowing on me.Just as suggestion but could the problem be more akin to wind burn , the constant airflow from the blower unit could be drying your skin out. I suffer from eczema and can get similar symptoms to what your described if I go out in a cold sharp wind.
try the helmet without the blower unit and see if that helps