Having it happen when going over bumps sounds like there is a connection problem somewhere, but it could be the pedal sensor wearing out. I guess that's the next easiest thing to test, so work back from that through a process of elimination. How many miles on the car?