In System Preferences -> General, there is a checkbox to control this behaviour. Basically, if you quit an application without closing the windows first, the windows are reopened when you restart it. Either close the windows before quitting, or uncheck that checkbox.