At the upper right side of the iTunes store, click on "Account".
Activate iTunes Plus here.
After that, if you go back to the main page and click on "iTunes Plus", the next window (upper right) will either give you the option to upgrade your library or tell you that everything is up-to-date.