Webmaster Forums - Website and SEO Help

Search Engines and Marketing => Website Crawling and Indexing => Topic started by: Peter97 on October 18, 2016, 02:02:26 AM

Title: Which is better Robots.txt or Meta Robots Tag?
Post by: Peter97 on October 18, 2016, 02:02:26 AM
Hello friends,

Which is better Robots.txt or Meta Robots Tag?
Title: Re: Which is better Robots.txt or Meta Robots Tag?
Post by: The Leader on October 30, 2016, 03:04:32 PM
Neither as they are two total different things.
The Meta Tags like title and description sit inside the website code to describe your content whereas the Robots.txt sits on the server to tell bots which pages not to crawl.
Title: Re: Which is better Robots.txt or Meta Robots Tag?
Post by: RH-Calvin on November 16, 2016, 01:17:54 PM
Robots.txt is better compared to Robots tag. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.