Are you sure? Reason being is that that pump is a cold start emissions deal. Once the engine is up to normal operating temps the pump is no longer needed. During the summer months I used the A/C quite a bit and while driving around town that sound was on more often which to me says its the radiator fan.

My charge air pump also isn't that loud either when I hear it in the morning.