X Window can be set up to look like anything you want.
Does this look like X?
http://moose.ca/content/projects/davis/DAVIS_v03a.png
If you really want to dump X I suggest doing something that is compatible with X or SDL or fbdev or whatever. Development of X apps via the network connection is invaluable - just export your display and you can work on the box anywhere. Also, when troubleshooting hook up the RJ45 and work from your desk instead of sitting in the driver's seat with some excuse of a keyboard.
When it's time to run on the dedicated hardware move your interface over and you are off to the races.
Collaboration is a tough nut to crack. If the "outsiders" don't have interest then they aren't going to pony up.