Initially, site owners submitted the address of a web site, or URL to the assorted engines like google, which would mail an internet crawler to crawl that web site, extract back links to other internet pages from it, and return details uncovered within the site to become indexed.[5] txt file https://www.youtube.com/watch?v=hgyQy18ZcIs