Things have changed again, but today was a big day, driving the transmitter with the D104 "lollipop" mic is working, finally..

The Cathode follower after the carrier oscillator is gone. I now have double sideband suppressed carrier at my IF frequency, this is a big step. My carrier suppression is over 60 dB and I have 45 dB of sidebands above the suppressed carrier.
The schematic and design have changed a bit.