You don't close programs; you close windows. You can have several Safari windows open at once — would you want them all to go away when you closed one?
Often, programs that are only one window (like Calculator) will quit when you close their window. Other programs will remain open until you quit them. That way, if you want to do something else in the program afterward, you just have to open a new window.