See Our Webmaster Tools for Windows and Mac

                                  

Which Type of file Use In Seo Disallow Tool..?

Started by ruhikhan, April 02, 2018, 02:15:18 AM


mvminfotech

Robots.txt file URL: www.example.com/robots.txt. Blocking all web crawlers from all content.
User-agent: * Disallow: /.
Using this syntax in a robots.txt file would tell all web crawlers not to crawl any pages on www.example.com, including the homepage.