It was an ordinary visible file when I tried it.
But an invisible file (dot file) can be deleted in Terminal with the rm command:
rm ~/Desktop/filename
That should delete the file named "filename" on your desktop.
Or you can install TinkerToys to make invisible files visible. Go to version tracker for that.