I have a problem where I have many usb drives including a few NTFS that I need to consolidate to one drive.
Total data stored is in excess of 6GB but many files are duplicated across the drives and many exist multiple times on each drive.
I have tried copying them all to a large 8TB RAID drive, but while copying the second or third drive there is always some sort of failure (I believe the enclosure may be faulty)
The aim of this method was to get them all into one physical volume and then use some sort of duplicate finder to clean up.
Having failed many times I'm wondering about software that might copy unique files from one disk to another.
(then I might get this done with a single smaller drive in lieu of the potentially faulty RAID)
It would first copy disk 1 in its entirety to an empty destination drive.
Then it would copy disk 2 to the same drive, but only files and folders which didn't now exist on the destination would be copied.
Next it would copy disk 3 to the same drive, but again files and folders which didn't yet exist on the destination would be the only files copied.
and so on...
Does such software (with a decent GUI) exist?