41 different robots | Hits | Bandwidth | Last visit |
Googlebot | 5543+59 | 189.11 MB | 31 Jul 2010 - 23:58 |
Yahoo Slurp | 4362+74 | 717.66 MB | 31 Jul 2010 - 23:50 |
Voila | 103+44 | 6.88 MB | 31 Jul 2010 - 23:27 |
Unknown robot (identified by 'bot*') | 493+123 | 52.71 MB | 31 Jul 2010 - 23:25 |
Unknown robot (identified by 'crawl') | 59928+903 | 511.44 MB | 31 Jul 2010 - 22:38 |
MSNBot | 787+610 | 136.57 MB | 31 Jul 2010 - 21:34 |
Yandex bot | 77+33 | 653.53 KB | 31 Jul 2010 - 20:26 |
Ask | 127+79 | 33.50 MB | 31 Jul 2010 - 19:14 |
Unknown robot (identified by empty user agent string) | 250+20 | 19.95 MB | 31 Jul 2010 - 17:07 |
Custo | 402+43 | 9.78 MB | 31 Jul 2010 - 13:42 |
Nutch | 26+21 | 122.38 KB | 31 Jul 2010 - 10:59 |
Jakarta commons-httpclient | 134+1 | 648.31 KB | 31 Jul 2010 - 09:33 |
MSNBot-media | 104+34 | 524.35 KB | 31 Jul 2010 - 06:41 |
Java (Often spam bot) | 61+1 | 636.90 KB | 31 Jul 2010 - 02:37 |
Harvest | 78 | 384.00 KB | 31 Jul 2010 - 02:28 |
BaiDuSpider | 47+37 | 18.21 MB | 30 Jul 2010 - 11:26 |
Sogou Spider | 3 | 8.48 KB | 30 Jul 2010 - 11:18 |
twiceler | 0+43 | 3.70 KB | 30 Jul 2010 - 04:49 |
Unknown robot (identified by hit on 'robots.txt') | 0+77 | 6.62 KB | 30 Jul 2010 - 02:52 |
Exabot | 15+15 | 60.50 KB | 30 Jul 2010 - 00:32 |
Heritrix | 261+1 | 23.23 MB | 29 Jul 2010 - 07:38 |
Speedy Spider | 69+63 | 620.80 KB | 29 Jul 2010 - 05:34 |
WGet tools | 11 | 1.30 MB | 28 Jul 2010 - 00:37 |
Mail.ru bot | 9+3 | 26.93 KB | 26 Jul 2010 - 17:15 |
Alexa (IA Archiver) | 1+1 | 3.15 KB | 26 Jul 2010 - 08:32 |
MJ12bot | 44+2 | 343.35 KB | 25 Jul 2010 - 16:54 |
Unknown robot (identified by 'spider') | 28+10 | 353.83 KB | 25 Jul 2010 - 01:57 |
Perl tool | 6 | 16.44 KB | 24 Jul 2010 - 23:56 |
Unknown robot (identified by 'robot') | 27+8 | 127.22 KB | 24 Jul 2010 - 23:11 |
Voyager | 4+2 | 16.26 KB | 23 Jul 2010 - 21:51 |
yacy | 3+1 | 271.04 KB | 22 Jul 2010 - 01:28 |
Turn It In | 193+1 | 6.89 MB | 18 Jul 2010 - 21:13 |
FavIconizer | 1 | 4.02 KB | 16 Jul 2010 - 14:17 |
Unknown robot (identified by 'discovery') | 423+99 | 14.56 MB | 15 Jul 2010 - 10:41 |
larbin | 2+2 | 13.09 KB | 12 Jul 2010 - 11:34 |
BBot | 1 | 748.34 KB | 10 Jul 2010 - 08:55 |
Findlinks | 1+1 | 5.61 KB | 08 Jul 2010 - 06:18 |
archive.org bot | 541+2 | 256.08 MB | 04 Jul 2010 - 01:30 |
Unknown robot (identified by 'hunter') | 1 | 7.13 KB | 02 Jul 2010 - 07:36 |
Allrati | 1 | 4.02 KB | 01 Jul 2010 - 21:39 |
Python-urllib | 1 | 3.31 KB | 01 Jul 2010 - 12:41 |