I use it when the car is dusty or has maybe a light coating from a quick rain.

If there is actual dirt on the car and you rub it around, you will scratch the finish, I don't care what kind of spray you put on it. Just my $0.02