The type of noise might be helpful here.

Is it a chirping, squeaking, clunking, thud?

I had a squeaking sound go away when I replaced the steering stabilizer.