Initially, webmasters submitted the handle of a webpage, or URL to the different search engines, which would mail an online crawler to crawl that webpage, extract one-way links to other webpages from it, and return info observed on the web page to be indexed.[5] By applying responsive design, robot directives, https://www.youtube.com/watch?v=0eLlfoHTk_E