Taking a screenshot will blank out the DVD player window in OS X for copyright reasons.
If you play the DVD using VLC instead, screenshot commands will work fine (Cmd-Shift-3 for fullscreen, Cmd-Shift-4 for just a window, more variations you will find in the keyboard shortcuts section of the Mouse & Keyboard pane in the System Preferences).