I pressed the pin in with a small center punch, and twisted and pulled the assembly, and out it came!
Supposedly, you can only do this IF your key is turned to the right one click.
Otherwise, you need to drill the pin out... but I can't speak to this, as mine decided to turn after I got the car towed home and the dash torn apart.