After you tap that mirror removal hole.. start the ball stud into the hole, and use it to twist the base back on (instead of the allen wrench when removing).
Maybe this will clairfy more.. And yeah.. I need to remove that big a$$ thumb wheel and put a nut in it's place.. LOL.