The USB Device extension is Apple's main USB software for many things - this is not the one to turn off.
What you may have seen and perhaps misunderstood is turning off other USB extensions, such as the
USB Iomega extensions etc. Even there, you may not have to turn them off, just get them to load
ahead of Apple's software - for example, click on the name of a given USB extension and insert one space before the start of the name - this advances that extension to the head of the line so that it is recognized before the Apple software kicks in.
Another workaround is to shut down, unplug all USB devices - startup, and after startup is completed, plug everything back in.