39 different robots | Hits | Bandwidth | Last visit |
Python-urllib | 803 | 2.59 MB | 30 Jun 2006 - 23:00 |
Googlebot | 734+29 | 4.34 MB | 30 Jun 2006 - 20:16 |
Unknown robot (identified by 'crawl') | 556+176 | 5.78 MB | 30 Jun 2006 - 23:29 |
Harvest | 691 | 17.83 MB | 30 Jun 2006 - 22:49 |
Java (Often spam bot) | 670+1 | 2.59 MB | 29 Jun 2006 - 15:33 |
Yahoo Slurp | 263+239 | 1.70 MB | 30 Jun 2006 - 23:53 |
MSNBot | 229+205 | 2.52 MB | 30 Jun 2006 - 22:41 |
Unknown robot (identified by 'bot*') | 93+26 | 1.01 MB | 29 Jun 2006 - 11:30 |
larbin | 50+21 | 273.25 KB | 30 Jun 2006 - 14:50 |
Ask | 51+16 | 408.11 KB | 23 Jun 2006 - 07:52 |
LinkChecker | 50+1 | 390.44 KB | 14 Jun 2006 - 01:04 |
ConveraCrawler | 48+1 | 294.85 KB | 21 Jun 2006 - 06:27 |
Unknown robot (identified by 'robot') | 0+27 | 1.80 KB | 30 Jun 2006 - 08:43 |
MSNBot-media | 19+7 | 73.76 KB | 29 Jun 2006 - 14:01 |
Findlinks | 19+7 | 160.89 KB | 30 Jun 2006 - 03:13 |
Unknown robot (identified by empty user agent string) | 4+18 | 17.27 KB | 30 Jun 2006 - 22:24 |
Voyager | 14+8 | 102.33 KB | 25 Jun 2006 - 14:40 |
IRLbot | 18+4 | 45.62 KB | 21 Jun 2006 - 15:38 |
BecomeBot | 15+3 | 83.46 KB | 19 Jun 2006 - 05:09 |
IBM Almaden Research Center WebFountain™ | 0+16 | 1.38 KB | 26 Jun 2006 - 08:26 |
ZyBorg | 11+3 | 57.91 KB | 30 Jun 2006 - 11:22 |
Alexa (IA Archiver) | 11+3 | 29.61 KB | 15 Jun 2006 - 20:58 |
NutchCVS | 6+4 | 37.91 KB | 30 Jun 2006 - 07:52 |
BaiDuSpider | 7+1 | 9.16 KB | 21 Jun 2006 - 04:07 |
noxtrumbot | 5+2 | 10.10 KB | 14 Jun 2006 - 14:19 |
aipbot | 6+1 | 65.44 KB | 21 Jun 2006 - 01:14 |
Voila | 3+3 | 9.33 KB | 27 Jun 2006 - 08:21 |
GigaBot | 2+4 | 6.65 KB | 22 Jun 2006 - 21:09 |
WGet tools | 4+1 | 7.57 KB | 18 Jun 2006 - 16:53 |
Shim-Crawler | 3+1 | 6.82 KB | 17 Jun 2006 - 09:00 |
Geniebot | 2+1 | 3.54 KB | 06 Jun 2006 - 09:40 |
Perl tool | 3 | 99.79 KB | 29 Jun 2006 - 18:21 |
Unknown robot (identified by hit on 'robots.txt') | 0+3 | 264 Bytes | 14 Jun 2006 - 13:30 |
Digger | 1+1 | 3.11 KB | 13 Jun 2006 - 13:09 |
topicblogs | 1+1 | 3.11 KB | 25 Jun 2006 - 21:48 |
MJ12bot | 1+1 | 22.41 KB | 03 Jun 2006 - 09:55 |
Unknown robot (identified by 'spider') | 0+1 | 88 Bytes | 23 Jun 2006 - 17:12 |
Heritrix | 0+1 | 88 Bytes | 05 Jun 2006 - 13:40 |
MSIECrawler | 0+1 | 0 | 07 Jun 2006 - 16:19 |