Downshifting will not hurt the car or clutch. I tend to take my foot off the gas and let the engine rev down. If I ever downshift I make sure I am going fast enough for the gear I am picking so I don't go into gear with high RPM's. I don't abuse the clutch or the brakes... I have 55K miles with plenty of brakes left.