I know what you mean, its annoying.
A device which is already installed will prompt for drivers again if its not inserted in exactly the same socket (and using hubs makes it worse) yet will then find the drivers on its own with no need for a CD or Web.
I haven't seen anyway round it but a snoop around the registry might reveal something