If that is the case, then mine is broken (which I wouldn't doubt).
WHen I turn the fan on, it blows. Regardless of hot, cold, etc,. I tend to start moving a bit before the car is really warm so I get cold air blowing on my hands the first block or two every time I take it out.