That's so wierd.. if it was the wheels, it would still vibrate when you take the spacers off, so it's not that.. so don't try getting them balanced...
I'd say maybe the spacers are slightly defective.. I mean thats the only thing that I can think of anyway.. if they are even a quarter milimeter off somewhere, it could affect the way the tires roll at, and cause a vibration.