When you take out the old drive, you can see what settings it had, and apply these to your new drive.
I would guess it should be master - just changed my harddrive and the jumper are set to Master. The only difference is that my iMac is a generation younger than yours (G3), but I guess it's the same...