+ Reply to Thread
Page 2 of 2
FirstFirst 1 2
Results 16 to 23 of 23
  1. #16
    Join Date
    Mar 2004
    Posts
    2,122
    I do see what you are saying there. Double the visitors half the bw. half the bw double the visitors LOL

    It is very interesting if you ask me. Some could be the size of the images, text, banners, etc...
    Originally posted by Matt
    Looking at it further, even more useless statistics.

    MSNBot 28830 572.32 MB
    Googlebot 13327 496.83 MB
    Inktomi Slurp 12451 1.13 GB

    It's clear that while googlebot eats twice the bandwidth as msnbot, Inktomi Slurp uses twice that of googlebot.

    As you can see, I'm bored today

  2. #17
    Join Date
    Mar 2004
    Posts
    2,122
    as of a site I just put online this past week.

    Robots/Spiders visitors (Top 25) - Full list - Last visit
    7 different robots* Hits Bandwidth Last visit
    Unknown robot (identified by 'spider') 50 426.06 KB 08 Aug 2008 - 11:56
    Googlebot 30 212.73 KB 06 Aug 2008 - 15:59
    Alexa (IA Archiver) 11 250.39 KB 08 Aug 2008 - 11:35
    Yahoo Slurp 10 91.30 KB 07 Aug 2008 - 06:56
    Unknown robot (identified by 'crawl') 4 144.88 KB 06 Aug 2008 - 00:09
    Unknown robot (identified by 'robot') 1 56.41 KB 06 Aug 2008 - 13:18
    Unknown robot (identified by 'bot/' or 'bot-') 1 9.80 KB 07 Aug 2008 - 03:56

  3. #18
    Join Date
    Sep 2002
    Location
    Sonoran Desert
    Posts
    2,681
    Hi Matt, I would advise you to not even pay attention to the bots because (unless it gets extremely excessive with bandwidth from bad bots, which is unlikely) there is not much that can be done or should be done due to lots of wasted time and frustration involved. Keep in mind the PPC firms, Adsense and AWstats ignore bot traffic anyway.

  4. #19
    Join Date
    May 2010
    Posts
    17
    If Googlebot comes to your sIte and cannot access It, your sIte may drop. we realized it was important to provide the ability for users to submit pages on their site and get real-time feedback on what Googlebot sees.

  5. #20
    Join Date
    Oct 2010
    Posts
    13
    A 'bot' is a type of malware which allows an attacker to gain complete control over the affected computer. Computers that are infected with a 'bot' are generally referred to as 'zombies'. One of the best defenses against threats like these is to run anti-virus and anti-spyware software on your computer.

  6. #21
    Join Date
    Nov 2010
    Location
    SouthField, MI USA
    Posts
    12
    Really awesome but my question is that they are really helpful for SEO and if they are can we use artificial crawler?

  7. #22
    Join Date
    Jun 2011
    Posts
    77
    Great counts n numbers using bots


    Good everypne. Can i know how can be the bots used

  8. #23
    Join Date
    Mar 2012
    Location
    Tennessee
    Posts
    22
    IMO, waste of time. They don't use enough bandwidth to really hurt you unless you have a really bad host. Just write good content and don't worry about spiders, people tend to get paranoid when monitoring them too much.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  

Sponsors

Poll

Besides domain registrations, I prefer to work with a registrar that also offers this service?
1. Hosting
2. Marketplace for buying/selling domains
3. Domain Parking
4. Free Webpage with For Sale message
5. Other
to see the Poll results!
 
DomainState.com
Domain Tools | Domain Directory | Registrar Stats | Domain Glossary | Industry Events | FAQ | Members | Terms | RSS | Link To Us | Advertise | Contact Us
Other Related Trellian Services:
Above Domain Parking Manager   |   Free Search Toolbar   |   Free Webpage Builder   |   Keyword Research   |   Search Engine Submission   |   SEO Tools
Copyright © 2002 DomainState.com a Trellian Company