people are actually doing this. Like you said, some people use a desktop. I, on the other hand, use a graphical VFD and a tight little interface. The Linux forum goes over this stuff but it is still young.
I don't know if you are familiar with the Empeg (later known as the Riocar) but it is the first mass produced linux-based car player.
The moral of the story: Linux kicks ***.