Solved it. PDFs without an extension (created by default using a layersplitting action in Illustrator) doesn't get transparent backgrounds anymore for some reason. Renaming them works.
Oh and it doesn't appear that Coverflow shows transparent PDFs no matter what in Leopard nor Snow Leopard.