I don't see how starting out in a higher gear doesn't automatically put more of a load on the clutch. It may not show up for quite some time, but I would think it would cause premature wear over the long run.
Also starting out in a higher gear (even if it's only 2nd gear) is "lugging" the engine. It may be ever so slight, but again, over time it adds up.
Just my opinion, but I tend to keep the cars I really like, a very long time, so I try to keep the wear and tear to a minimum.
But to answer your question Gizmow, unless you plan on keeping your car for the duration, you probably won't ever notice a problem.