Yes, just plug in the cables and set TCP/IP to Ethernet
If you are using the same OS on the computers (Mac or Windows).
Then just set your TCP/IP setings to DHCP.
If you are using different OS on each computer.
Then use Manual as the setting and create a few ip address that won't conflict... Such as 192.168.2.1 and 192.168.2.2 and set the gateway to be the same IP as your computers. The NetMask should be 255.255.255.0.
Have Fun,
jnunez