Search | View Active Threads | View New Posts
Current Time: 12:19 AM


+ Reply to Thread
Results 1 to 3 of 3
  1. #1
    Join Date
    Apr 2014

    Is there any limit for robots.txt file?

    Is there any limit for robots.txt file?

  2. #2
    Join Date
    Feb 2019
    We can use max. 500KB file size for Robots.txt

  3. #3
    Hi Friend,
    Yes, there is a limit to robots. txt file in terms of filesize 500 KB as Vipin points out. A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Sponsors Domain Registrar, Marketplace and Revenue Optimizer
Domain Escrow Services
Trellian Direct Search Network

Industry Events

11-14 August 2019
Affiliate Summit East
New York, NY

4-6 March 2019
Las Vegas

15-18 September 2018
MERGE 2018
Orlando, FL


How do you invest in domains?
to see the Poll results!
Domain Tools | Domain Directory | Registrar Stats | Domain Glossary | Industry Events | FAQ | Members | Terms | RSS | Link To Us | Advertise | Contact Us
Other Related Trellian Services: Registrar  | Marketplace  | Domain Manager  |  Free Search Toolbar  |  Free Webpage Builder  |  Keyword Research
Direct Search Navigation  |  Search Engine Submission and SEO Tools
Copyright © 2002 a Trellian Company 2014 Bronze Sponsor - Internet Commerce Association