33 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 8968+472 | 282.84 MB | 30 Sep 2010 - 23:52 |
Googlebot | 2362+50 | 71.17 MB | 30 Sep 2010 - 23:11 |
Unknown robot (identified by 'bot*') | 1529+43 | 28.47 MB | 28 Sep 2010 - 07:31 |
Yahoo Slurp | 782+61 | 44.31 MB | 30 Sep 2010 - 22:30 |
MSNBot | 83+123 | 4.34 MB | 30 Sep 2010 - 23:19 |
Java (Often spam bot) | 165 | 2.88 MB | 29 Sep 2010 - 18:51 |
Heritrix | 159+1 | 14.99 MB | 01 Sep 2010 - 05:31 |
BaiDuSpider | 99+7 | 342.19 KB | 30 Sep 2010 - 15:10 |
Harvest | 71 | 84.90 KB | 30 Sep 2010 - 07:41 |
Jakarta commons-httpclient | 66 | 82.76 KB | 30 Sep 2010 - 10:34 |
Unknown robot (identified by 'discovery') | 26+26 | 69.27 KB | 20 Sep 2010 - 19:16 |
Unknown robot (identified by empty user agent string) | 32+14 | 108.21 KB | 30 Sep 2010 - 03:03 |
Yandex bot | 32+13 | 561.93 KB | 30 Sep 2010 - 23:08 |
Ask | 24+9 | 1.46 MB | 19 Sep 2010 - 14:41 |
MSNBot-media | 19+12 | 80.64 KB | 29 Sep 2010 - 00:49 |
Voila | 20+10 | 39.76 KB | 30 Sep 2010 - 03:24 |
Turn It In | 27+1 | 555.16 KB | 14 Sep 2010 - 19:21 |
Unknown robot (identified by hit on 'robots.txt') | 0+26 | 2.23 KB | 29 Sep 2010 - 23:17 |
Unknown robot (identified by 'robot') | 11+4 | 47.03 KB | 26 Sep 2010 - 03:10 |
Custo | 7+7 | 27.53 KB | 30 Sep 2010 - 13:58 |
Sogou Spider | 14 | 48.32 KB | 13 Sep 2010 - 14:48 |
Exabot | 6+6 | 6.58 KB | 23 Sep 2010 - 11:56 |
Speedy Spider | 6+6 | 38.20 KB | 21 Sep 2010 - 02:53 |
Nutch | 8+2 | 33.46 KB | 17 Sep 2010 - 07:38 |
Perl tool | 9 | 17.93 KB | 22 Sep 2010 - 20:10 |
MSIECrawler | 5 | 33.06 KB | 04 Sep 2010 - 23:28 |
Unknown robot (identified by 'spider') | 2+2 | 7.07 KB | 28 Sep 2010 - 13:22 |
Alexa (IA Archiver) | 1+1 | 3.54 KB | 05 Sep 2010 - 18:21 |
yacy | 2 | 43.77 KB | 17 Sep 2010 - 01:54 |
MJ12bot | 1+1 | 8.34 KB | 24 Sep 2010 - 13:12 |
Python-urllib | 0+1 | 88 Bytes | 18 Sep 2010 - 00:00 |
WGet tools | 1 | 3.45 KB | 03 Sep 2010 - 20:51 |
Netcraft | 1 | 3.45 KB | 06 Sep 2010 - 19:31 |