It is shown if "Show loading indicator" in the Document Inspector is checked.
Videos aren't preloaded and won't hold up page loading, but it could very well be other assets on your page. I'd recommend firing up the Developer Console's Network tab and see what might be causing long loading times. Preloading of resources can be disabled in the Resources Library by selecting the asset and unchecking "Preload."