Try using brass wool instead of steel wool. No tiny steel particles to rust.

I had some polishing compound residue in the grooves on the hood. It wouldn't wash out and i didn't want to scratch the finish with hard rubbing or use a solvent that might attack the new paint.

The clay bar with cleaner / lubricant took it right off. Same thing with the adhesive streaks left from the plastic covers that are on the car when it ships.