Calendar: how do I deselect?

Hope I explain this ok:

In Calendar, I sometimes accidentally select some events, which create these huge grey block of selected events. Then they become grey boxes that don't unselect no matter where I click the cursor. How do I deslect, this is a real nuisance.Thanks.