It's USB. You can connect and disconnect as you please. For the display, I don't know if hotplug detect for the monitor works on the mini, but you could set your app to start at login, set up auto login, and just boot with the power button to get it going without a display.
Steve