Attack it from behind - inside/engine bay side.
If memory serves me correct, you have to push the center of the rivet towards the head (expanding rivet) - use a bent paper clip etc. for ease/tight areas to push the center.
It can be done - the RH side is the easiest.