Which is better Robots.txt or Meta Robots Tag?

Started by rubanisharma, June 19, 2017, 06:38:42 AM

rubanisharma

Hlo Friends,
Can anyone tell me, Which is better Robots.txt or Meta Robots Tag?

sinelogixtech

It's depends on the situation or else both having their own importance.

Suppose you want to block indexing of only one page in Search Engine, than in this case robots meta tag will be a good option instead of robots.txt. Because if you are blocking a single page by using robots.txt then there is some chances to appear that URL in SERP, For Example check below FB page that is blocked by using robots.txt and its still appearing in SERP.

RH-Calvin

Robots.txt file is better compared to meta robots tag. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
Cheap VPS | $1 VPS Hosting
Cheap Dedicated Servers | Free Setup with IPMI