FPM - Yes, you can get that shine by hand, you just have to work at it. I actually have never used a rotary buffer on my crossfire. When I first bought the car, I used a random orbital buffer with a 2,500 compound to remove some of the swirl marks. However, since then, I have been polishing by hand only.
1. Clay bar your car so you can start with a good finish.
2. Take a microfiber towel, cut it in 2 pieces so you can use it to apply 2 coats of polish. Fold one of the pieces and pour a small amount of Meguiars Deep Crystal polish on it. Apply the polish to the entire car in a straight back and forth motion. Let it dry for about 5-10 minutes and use another microfiber towel to remove the polish, turning the towel often.
3. Repeat step 2 again
4. Using another microfiber towel piece, apply a coat of Meguiars NXT tech wax in the same fashion as the polish. Let wax dry about 20 minutes and then remove with a towel.
5. Apply a coat of Liquid Glass in the same fashion as the polish and wax. Let dry and remove.
6. Follow up by misting the car with TW ICE spray, one panel at a time. Use a clean microfiber towel to wipe it off.

I think you'll find that these steps will make your car look very nice by hand. If you still have swirl marks, you can either follow golfdude's tips with the rotary, or purchase a random orbital buffer and use that. I can give you some advice on how to use the R.O. An electric polisher is easier and can remove more scratches/swirl marks as long as you are experienced. I have found if you maintain your paint, you can keep it looking great by hand. Once a week I apply a coat of polish followed by a coat of NXT or liquid glass. Let me know if I can answer any questions for you.