32 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 6962+974 | 221.61 MB | 30 Sep 2011 - 23:44 |
Unknown robot (identified by 'robot') | 1133+10 | 22.05 MB | 29 Sep 2011 - 00:54 |
Yahoo Slurp | 821+61 | 38.18 MB | 30 Sep 2011 - 23:53 |
Googlebot | 764+64 | 31.03 MB | 30 Sep 2011 - 23:58 |
Unknown robot (identified by 'bot*') | 259+290 | 22.25 MB | 30 Sep 2011 - 23:17 |
Heritrix | 171+1 | 15.94 MB | 02 Sep 2011 - 16:51 |
Sogou Spider | 165 | 547.78 KB | 30 Sep 2011 - 20:43 |
BaiDuSpider | 119+35 | 2.49 MB | 30 Sep 2011 - 19:34 |
psbot | 138+4 | 6.71 MB | 28 Sep 2011 - 02:01 |
Turn It In | 130+1 | 6.46 MB | 25 Sep 2011 - 01:44 |
Java (Often spam bot) | 128 | 2.85 MB | 21 Sep 2011 - 04:03 |
Yandex bot | 65+25 | 1.08 MB | 29 Sep 2011 - 16:01 |
Unknown robot (identified by 'spider') | 76+3 | 692.66 KB | 30 Sep 2011 - 18:05 |
Harvest | 75 | 147.28 KB | 27 Sep 2011 - 16:34 |
Unknown robot (identified by '*bot') | 32+31 | 1.60 MB | 30 Sep 2011 - 04:32 |
Unknown robot (identified by hit on 'robots.txt') | 0+41 | 3.52 KB | 30 Sep 2011 - 12:42 |
Jakarta commons-httpclient | 36 | 45.81 KB | 30 Sep 2011 - 10:13 |
Speedy Spider | 16+17 | 108.56 KB | 30 Sep 2011 - 13:45 |
Voila | 20+10 | 39.94 KB | 30 Sep 2011 - 15:41 |
Unknown robot (identified by 'discovery') | 27+2 | 99.72 KB | 30 Sep 2011 - 11:08 |
Unknown robot (identified by empty user agent string) | 27 | 50.39 KB | 28 Sep 2011 - 20:34 |
Custo | 12+11 | 43.41 KB | 30 Sep 2011 - 13:20 |
Perl tool | 15 | 38.64 KB | 29 Sep 2011 - 23:57 |
Nutch | 9+5 | 186.67 KB | 29 Sep 2011 - 12:05 |
Exabot | 6+6 | 20.83 KB | 29 Sep 2011 - 00:08 |
MJ12bot | 6+6 | 28.70 KB | 28 Sep 2011 - 08:45 |
yacy | 3+1 | 47.32 KB | 30 Sep 2011 - 17:49 |
WGet tools | 2 | 86.27 KB | 27 Sep 2011 - 15:34 |
DoCoMo | 1+1 | 3.54 KB | 16 Sep 2011 - 05:16 |
larbin | 1+1 | 3.54 KB | 08 Sep 2011 - 22:15 |
Python-urllib | 1 | 3.45 KB | 26 Sep 2011 - 16:18 |
Netcraft | 1 | 3.45 KB | 26 Sep 2011 - 11:23 |