I guess you've never clayed before. You can use car wash soap if your cheap but detail spray is better. You have to keep the surface lubricated or the clay will grab. (not what you want) You figured this out already. My guess is that re claying with plenty of detail spray would do the job. I doubt you damaged the paint, just made yourself more hours of work.

Les