I am thinking that perhaps it is water coming under while driving due to the backflow, draft, vacuum created as the car moves along. If it is not cleaned off, it dries and builds up so that it is now visible. Analogy would be the rain and road dirt your wiper does not clean off on the periphery of your windshield.

Not on the XF of course.