Ok, bear with me, not a mechanical engineer by any means!

It would seem to me that the heavier crank pulley would actually help once it is in motion due to increased weight/mass keeping its inertia? I can see a faster start but also a faster slow down, I.E. it would take more power to keep the lighter pulley spinning at 4500 RPM once you hit 4500 RPM?