Assuming you just want to start from scratch, you should delete the files in USER->Music->iTunes
Leave the iTunes Music folder, though, just in case there's anything still in there.
There was actually no need to delete the iTunes application, since it doesn't store any of your custom settings or library.
You might need to go to Library -> Receipts and delete the files that have iTunes in the name in order to reinstall with the iTunes installer.