Hello friends,
What is the limit of a robot.txt file?
There is limit of 500KB of the robot.txt file. You can ask your web hosting provider to upload it under your control panel (root directory of the website) and webmaster will pick it automatically.
If you have access then you can upload it from your end.
A most extreme document size might be authorized per crawler.
Content which is after the most extreme document size might be overlooked.
Google as of now upholds a size utmost of 500kb.
Google has a limit of only being able to process up to 500 KB present in the robots.txt file.