The standard disclaimer is that piping a text file to rm is extremely dangerous, and if there's one little error in your file somewhere, you could end up deleting a lot more than you intended to.
What I myself would do instead would be to make a temporary folder somewhere, and then use xargs -J % mv % /path/to/temporary/folder/ instead of xargs rm -f. That way, it will simply move the files to the folder, and you can then inspect the contents of the folder to make sure it contains only the stuff you want to delete before trashing the folder.