This is a view of the underside of the center console.


As you can see, the front part of that trim panel is held in by snap in clips (the ones you've pried up) but the back is held in by two screws (one shown to the right of the yellow writing and the other shown in between the two red arrows on the right of the picture) You'll need a torx bit screwdriver to remove those screws.

Credit to member Larry Hitze for all these photos I have re-posted here on this thread . . .