33 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 7070+459 | 275.01 MB | 30 Sep 2010 - 23:52 |
Unknown robot (identified by 'spider') | 3369 | 24.96 MB | 20 Sep 2010 - 13:15 |
Unknown robot (identified by 'bot*') | 1431+15 | 24.29 MB | 30 Sep 2010 - 10:58 |
Googlebot | 833+33 | 5.85 MB | 30 Sep 2010 - 23:32 |
Yahoo Slurp | 745+60 | 11.82 MB | 30 Sep 2010 - 23:04 |
MSNBot | 116+205 | 701.99 KB | 30 Sep 2010 - 21:25 |
Java (Often spam bot) | 158+1 | 251.68 KB | 30 Sep 2010 - 20:34 |
Heritrix | 125+1 | 6.94 MB | 01 Sep 2010 - 04:54 |
Yandex bot | 106+19 | 2.00 MB | 30 Sep 2010 - 17:36 |
Unknown robot (identified by empty user agent string) | 95+13 | 578.69 KB | 30 Sep 2010 - 03:02 |
Jakarta commons-httpclient | 68 | 54.45 KB | 30 Sep 2010 - 10:28 |
Harvest | 58 | 86.41 KB | 30 Sep 2010 - 09:45 |
BaiDuSpider | 40+6 | 126.61 KB | 30 Sep 2010 - 18:52 |
Unknown robot (identified by 'discovery') | 18+18 | 65.76 KB | 20 Sep 2010 - 14:13 |
MSNBot-media | 21+13 | 103.07 KB | 18 Sep 2010 - 12:38 |
Turn It In | 25+1 | 330.07 KB | 22 Sep 2010 - 10:55 |
Speedy Spider | 10+15 | 112.34 KB | 21 Sep 2010 - 15:35 |
Ask | 14+10 | 248.83 KB | 24 Sep 2010 - 19:22 |
Voila | 19+5 | 231.32 KB | 29 Sep 2010 - 09:49 |
Exabot | 10+9 | 26.19 KB | 28 Sep 2010 - 10:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+19 | 1.63 KB | 30 Sep 2010 - 02:51 |
Nutch | 13+4 | 65.80 KB | 27 Sep 2010 - 12:07 |
Unknown robot (identified by 'robot') | 10+4 | 46.43 KB | 26 Sep 2010 - 03:10 |
Sogou Spider | 13 | 41.87 KB | 13 Sep 2010 - 14:45 |
Perl tool | 8 | 13.55 KB | 22 Sep 2010 - 19:34 |
MJ12bot | 2+3 | 18.71 KB | 24 Sep 2010 - 13:13 |
Alexa (IA Archiver) | 1+1 | 3.31 KB | 02 Sep 2010 - 02:08 |
VSE | 1+1 | 3.31 KB | 18 Sep 2010 - 17:53 |
WGet tools | 2 | 6.44 KB | 19 Sep 2010 - 23:53 |
yacy | 1 | 93.48 KB | 17 Sep 2010 - 02:04 |
lwp-trivial | 0+1 | 88 Bytes | 20 Sep 2010 - 12:21 |
Python-urllib | 0+1 | 88 Bytes | 17 Sep 2010 - 23:47 |
Netcraft | 1 | 3.22 KB | 06 Sep 2010 - 19:25 |