i assume you both have the client installed on your computers.
can you ping each other? if you can, then don't worry about explorer/finder. just open the game and one of you create a game and the other one join it via ip address.
if you can not ping each other.
then you are going to need to check your ip settings, network cable, etc, etc.