I'm assuming that the car was freshly washed before you did this.

If not then you probably had some surface dirt or dust that got into the microfiber cloth.

Before I do any type of waxing or polishing, I wash the car and usually run a clay bar over it, then I polish.