Yea, a TRUE '04 is a unique bird, they are limiteds (and Base models were never available with automatics, anyway) and were the only year the car was built with that fancy auto-dimming rear view mirror.
The SRT is a 335hp car, lots of fun, very fast - but my observation has been that it can be even more costly to maintain. I'd say go with the '04 - it sounds like a good fit for you.
THen meet us at the next GTG in your area!