The AirPort Utility offers three options for PPPoE connections under "PPPoE Options": Always On, Automatic (which is connect on demand), and Manual. When you select Automatic or Manual, you need to select how long the base station should wait before disconnecting because it's idle.
I have my network set up to stay connected always. If I'm going to be away for a while, I turn off the computers and the network equipment. When I turn the network equipment back on, it automatically reconnects because it's set to stay connected, and there's no fuss about manually reconnecting.