Yes, Macs can read and write to FAT32 volumes right out of the box.
However, you should stick with storing flat data files on the volume. Applications probably won't work right.
Couldn't you just hook up the FAT32 to the new Mac and copy all the music over first before formatting?