Because I am using the Sound Blaster XMOD. You can only use either computer sound or line-in sound. From the manual "if you connect both your computer and external audio source to Xmod, you will only hear sound played back from your computer"
Of course, probably the best route is to get another USB sound card that works properly with a line-in input. But hey, I like supporting innovators like Mitch