I see the shiny wear on the seal face, to me this indicates a seal not concentric with the shaft or a worn bearing. The shaft must run concentric to the seal or the seal will have a slightly oval bore which will wear more on the longest axis of the oval shape.
You do not show the surface finish of the area on the shaft where the seal runs, too rough or too smooth will result in excess wear at that point.
Extra pressure from two springs will also lead to a faster failure of the seal in the long run. If the seal had needed extra pressure it would have had two to start with.
Replace the front bearing if it is worn.