I'm not certain but does mpg321 support the other formats? It is an ALSA app meant to replace the OSS only mpg123. That may be a stumbling block for you depending on your audio hw physical configuration and/or if you haven't moved to ALSA yet.
Also look at XMP and ogg123 (vorbis-tools). Dunno if it does everything you want though or if they are OSS/ALSA/whatever.