Webmaster Forums - Website and SEO Help

Search Engines and Marketing => Website Crawling and Indexing => Topic started by: rubanisharma on June 19, 2017, 06:38:42 AM

Title: Which is better Robots.txt or Meta Robots Tag?
Post by: rubanisharma on June 19, 2017, 06:38:42 AM
Hlo Friends,
Can anyone tell me, Which is better Robots.txt or Meta Robots Tag?
Title: Re: Which is better Robots.txt or Meta Robots Tag?
Post by: sinelogixtech on June 20, 2017, 02:08:25 AM
It's depends on the situation or else both having their own importance.

Suppose you want to block indexing of only one page in Search Engine, than in this case robots meta tag will be a good option instead of robots.txt. Because if you are blocking a single page by using robots.txt then there is some chances to appear that URL in SERP, For Example check below FB page that is blocked by using robots.txt and its still appearing in SERP.
Title: Re: Which is better Robots.txt or Meta Robots Tag?
Post by: RH-Calvin on June 23, 2017, 01:41:22 AM
Robots.txt file is better compared to meta robots tag. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.