I haven't noticed it since 10.4. Have you recently upgraded?
Incidentally, for anybody wondering, there used to be a bug where the left-right audio balance would slowly drift toward one side. I think it might have had to do with the brand of speakers you used or something, because I didn't see it on every computer.