Um ya you need a wireless router. you can get them for under $50 from Netgear. Linksys sucks.
If you want to spend lots get the Apple Airport base stations.
P.s. don't bother with a access point, the usually cost more then the entire wireless router.