If it's consistent I'm more inclined to think something fuel-system related - the fuel pump is located behind and down low where it could sound like exhaust to some drivers, and it *consistently* turns on when the key does.

While I'm sure backfiring might be possible by some coincidence when you shut the engine off and turn the key back to on, I highly doubt it'll happen consistently enough to cause this issue.