Text only | Text with Images

Webmaster Forums - Website and SEO Help

Search Engines and Marketing => Website Crawling and Indexing => Topic started by: ankitasharma123 on April 20, 2017, 01:50:07 AM

Title: Why We Use robot.txt file In Seo..?
Post by: ankitasharma123 on April 20, 2017, 01:50:07 AM
Hello friends,

Why We Use robot.txt file In Seo..?
Title: Re: Why We Use robot.txt file In Seo..?
Post by: sinelogixtech on April 21, 2017, 02:33:05 AM
Robots.txt is text files mainly tell to crawler that it is permitted any website directory. The use of robots.txt is to disallow crawlers from visit private folder or content that gives them no extra information.
Title: Re: Why We Use robot.txt file In Seo..?
Post by: astrologerhome on April 21, 2017, 04:31:05 AM
This file is very important in SEO. This file is related to Crawlers. It contains instructions for crawlers.
Text only | Text with Images