Go ahead and add as many assets as you like to your library.
Click on the library name to open up the asset browser from where you can add images, videos, and audio files.
Upload assets by either dragging and dropping them or by clicking the "click to browse" link. You can batch upload multiple assets, making it very easy to add all your assets quickly.
Your asset library is now ready to use.