You're probably not going to hurt anything. Your only real concern should be safety. Sitting at a light in neutral is an "out of control" situation. If something happens you lose the ability to maneuver away quickly. Keeping your foot on the brake even when the car will not roll away further helps you to control your car if someone hits you from behind. But don't feel bad if you don't do it. I fail in both the matters at times.