Next time someone says anything about it being a girls car, tell them to find another XF owner on the road and tell the guy driving that XF the same thing he told you.
Or, as Dan suggested, you can tell them to find another XF roadster owner on the road and look to see if she has her top down.