What is the limit of a robot.txt file?

  • 3 Replies
  • 95 Views
*

ruhikhan

  • Jr. Member
  • **
  • 71
  • +0/-0
    • View Profile
    • Muslim Vashikaran Solution
What is the limit of a robot.txt file?
« on: January 22, 2018, 02:53:04 AM »
Hello friends,

 What is the limit of a robot.txt file?

*

sinelogixtech

  • Sr. Member
  • ****
  • 431
  • +0/-0
    • View Profile
Re: What is the limit of a robot.txt file?
« Reply #1 on: January 22, 2018, 11:23:39 PM »
There is limit of 500KB of the robot.txt file. You can ask your web hosting provider to upload it under your control panel (root directory of the website) and webmaster will pick it automatically.

If you have access then you can upload it from your end.

*

martindam

  • Jr. Member
  • **
  • 99
  • +0/-0
    • View Profile
Re: What is the limit of a robot.txt file?
« Reply #2 on: February 08, 2018, 06:27:56 AM »
A most extreme document size might be authorized per crawler.
Content which is after the most extreme document size might be overlooked.
Google as of now upholds a size utmost of 500kb.

*

esourceparts

  • Jr. Member
  • **
  • 54
  • +0/-0
    • View Profile
    • iphone repair Mississauga
Re: What is the limit of a robot.txt file?
« Reply #3 on: April 04, 2018, 01:44:25 AM »
Google has a limit of only being able to process up to 500 KB present in the robots.txt file.
cell phone parts store , Motorola parts , Google pixel phone parts