Which one is better Robots.txt or Meta robots Tag

Started by maxsamuel, September 14, 2012, 05:02:01 AM

maxsamuel

Which one is better Robots.txt or Meta robots Tag ?

josshray

These are the Google robots which check the site text

ushahm

If you block a page with robots.txt, Google bot will never crawl the page and will never read any meta tags on the page.If you allow a page with robots.txt but block it from being indexed using a meta tag, Google bot will access the page, read the meta tag, and subsequently not index it.
a. Robots.txt won't stop a URL being displayed in Google serps.
b. meta 'noindex' will stop a URL being displayed in Google serps.

Black Ninja

 Robots.txt is better than Meta robots Tag..! But if your website have less than 100 pages then you can you Meta robots Tag on every page. If you have CMS website and your website have more than 100 page in this case robots.txt very useful to manage page.

virtueinfo11

Both are good but when you have very big site at that time robots meta is very useful

Graham

I think both of them are important for SEO in there own way, now you have to intelligently decide which one is perfect for your site. :)

icecube media

Hi,

Both are same as robots txt is used to stop web crawler not to crawl particular page or content as meta robots work is also same . The main difference is of structure how to use them both. Working of both robots.txt ant meta robots are same.

marymnewland


paddy1

Both are important but robots.txt plays a major role from Search Engine point of view.

marketleader

#9
I think Robot.txt is important than Meta tags.
Robot.txt contain the entire detail about the website.
Meta tags contains the Main keywords details.

Alex Thompson

Both are same as robots txt is used to stop web crawler not to crawl particular page or content as meta robots work is also same . The main difference is of structure how to use them both. Working of both robots.txt ant meta robots are same.


MaryJacob

If you are willing to block the pages, then robot.txt is the best option to use. Search engine bots would not have the option to index the web pages.