From your pictures, I don't see very much rubber missing.
I'd replace the gasket and drive on, but that's just me, I could be wrong and that might turn out to be expensive.