I've noticed this too. I'll explain my situation, and then why I think it's happening.
We have a massive 24-port 100 Mbit hub at work in our computer lab, and when I take my 12" iBook G4 to work, I usually hook it up to one of the ports on the hub (we have no wireless). Local LAN access and Internet access have always been snappy, even though we're on a hub and our lab network is pretty heavily-trafficked. As you know, hubs are pretty "dumb" devices in that whatever comes in one port is repeated to all the other ports -- the hub leaves it up to the Ethernet adapter/OS on the receiving side to filter out the Ethernet frames that are not meant for that station.
This used to never be a problem up until I showed up at work one day with 10.4.3 installed.
We have a FreeBSD server running Samba that we dump benchmarks and other huge data onto. As soon as a friend of mine started a ~15 GB transfer, my network access went to ****. My ping times to the local server were abysmal, my transfer rates to the local server were in the tens of kilobytes, and the Internet was pretty much unusable.
What seems to have happened is that the Ethernet adapters have been put into promiscuous mode with 10.4.3. What that means is that the adapter accepts everything as being meant for it, and leaves it up to the OS to filter the packets. This, unfortunately, completely kills your network connection if you're receiving thousands of packets per second that are not meant for you. Within about one hour I had clocked up something like 1 million discarded packets.