Well, it doesn't happen in non-video apps like iTunes, finder, the desktop, etc. It does happen with different video codecs though. Some .movs will do it it, while others won't; some .mpgs will do it while others won't.
I ran the Apple hardware test that is supplied on the install disk, and it said that everything is fine.