The problem with doing it with a DPDT relay is you're running audio through a circuit that uses an electromagnet as the switching device and thus introducing "noise" to the amplifier which sends all that "noise" through to the speakers.