Main thing to remember about people getting pissed that you may be able to 'beat' their car... it's called 'Insecurity'... It's all about massaging their ego, because nobody does it for them.
I'm so laid back at the track, I had the head instructor for my group (HPDE2 in NASA) tell me I was silly to ask for an instructor ride along... "Did I need a pacifier too?" was the quote. He had followed me for half a lap and said "You're driving the wheels off that car... you shouldn't be in this class anymore. Move up already.". I think I just needed that slap in the face to convince me.
Some guys on the track are that way too... they just can't stand to be passed. Gets them all wound up... and we aren't even racing in HPDE2... not against the clock or each other.
The supercharged CTS-V is a beautiful car, but at over 4200 pounds of curb weight, it's power to weight ratio is not too far off from the SRT6. Add a nice ECU tune and a supercharger over drive pulley and you could hold your own in acceleration with the CTS-V... and I know you could beat it on the road courses or slalom.
So smile ear to ear next time and say... "Yep, that's a mighty fine ride you got there... I won't try to race you. I have more important things to do with my time."