How to solve robots.txt error ..?

  • 3 Replies
  • 111 Views
*

indiaastro

  • Newbie
  • *
  • 14
  • +0/-0
    • View Profile
    • Vashikaran Specialist in mumbai
How to solve robots.txt error ..?
« on: June 05, 2019, 03:51:21 AM »
Hello friends,

How to solve robots.txt error ..?

*

Rscomp

  • Newbie
  • *
  • 49
  • +0/-0
    • View Profile
Re: How to solve robots.txt error ..?
« Reply #1 on: June 07, 2019, 07:15:30 AM »
have you made sure your robots.txt is loading in your browser by adding robots.txt after your domain same as a normal page and can you see contents? has your site been down in this period? have you changed the contents of the file just before this issue? are you sure Googlebot hasn't come back since that date - whats your analytics say? do an index site: search for your domain to see if it is in google.

*

Jessicad

  • pgdme business college in chennai
  • Sr. Member
  • ****
  • 289
  • +0/-0
  • AIMED
    • View Profile
    • AIMED Academy for foreign languages
Re: How to solve robots.txt error ..?
« Reply #2 on: June 10, 2019, 03:43:16 AM »
A robots.txt file is handy for telling search engines which parts of a website should be crawled/indexed and which parts shouldn’t. This can be useful in certain situations where you want to keep a page or an asset hidden from search engines.

*

tanwirjain

  • Newbie
  • *
  • 19
  • +0/-0
    • View Profile
    • Serverstack
Re: How to solve robots.txt error ..?
« Reply #3 on: June 10, 2019, 05:08:52 AM »
Create a new robots.txt file and reupload it.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper