I'm wondering how bad of an idea this would be....

I'm about to put a computer in my car and I want to keep my head unit in my glove box just in case I want FM radio/CD/External audio source and just in case my computer isn't working properly.

My plan is to hook up three dpdt relays (one left channel, one right channel, one amp power) that are controlled by the computer so that by default the head unit is connected to the amplifiers and then when the fusion brain says so, the computer will be connected to the amps.

How badly do you think this will affect sound quality?