What you'll find you've done is you've set it to copy the whole folder (look in preferences).
Its not very intuitive and took me ages to figure out:
Go and edit the location in the publish menu. When it says copy blog folder, leave that unchecked as then it copies to a sub-folder (of random numbers and so on). Does that make sense?