Joule,
Did I read you right? This is going to be your first car?
Are you sure you want to do this 'cause you will be saddled with a real problem. This car costs a lot to keep, insure, fix and maintain. And you will have to keep it for a long time 'cause once you go Crossfire, you never go back to regular cars.
I suggest you go for an '05 or '06 limited coupe with an auto and just enjoy the ride. You won't have to impress your date with shifting skills and you'll free up a hand to play with the radio.
Or buy a stick and learn what real driving is all about. Either way, the XF will spoil you. You can't find anything close for less than twice the money, even if you paid sticker.
But you don't have to do that. If you can't find what you want for under $22k new or $16k used I'm sure there are plenty of folks here who can point you in the right direction.
Do it soon 'cause they ain't making no more.

Roadster with a stick