Are you using digital sound out? If so, that's normal. You control the volume with your receiver (or whatever component you're connecting to).
If you aren't using digital out, then kill coreaudiod. It will restart automatically. If that still doesn't do the trick, logout/login or reboot.