Boiler's advice is spot-on, but on the other hand, I test drove a Base Roadster with 120,000 miles on it and it shifted smooth, even going from 1 to 2.
I've said it before and I'll say it again - these cars are gonna age very well !
(Mine now has 82,000 on it, it's way better than when I bought it with 42,000)
In short, this is NOT an indication of abuse, nor is it abnormal in any way. In fact, it's about the only complaint 6 speed XF owners have.