Webmaster Forums - Website and SEO Help

Search Engines and Marketing => Search Engine Optimization SEO => Topic started by: sonamsharma on April 03, 2019, 02:23:55 AM

Title: what is robot.txt in blogger..?
Post by: sonamsharma on April 03, 2019, 02:23:55 AM
Hello friends,

what is robot.txt in blogger..?
Title: Re: what is robot.txt in blogger..?
Post by: 12Three on April 04, 2019, 12:21:04 AM
Robots.txt is a text file on server in that you can write which directories and web pages or links should not be included for search results. It means you can restrict search engine bots to crawl some directories and web pages or links of your website or blog. Now custom robots.txt is available for Blogger.
Title: Re: what is robot.txt in blogger..?
Post by: RH-Calvin on April 04, 2019, 12:52:03 AM
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
Title: Re: what is robot.txt in blogger..?
Post by: Akash-Varma on April 08, 2019, 07:27:15 AM
Quote from: RH-Calvin on April 04, 2019, 12:52:03 AM
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.

Yes, You have explained very well.Thanks for sharing such kind of information.