iPhoto does a lot of stuff while importing, like generating high quality thumbnails for its catalog.
You can always import photos later direct from the hard drive...
A media reader / card slot lets you copy images direct to hard drive in the Finder without the overhead, then import into iPhoto later. Personally, I wouldn't do it any other way.