32 different robots | Hits | Bandwidth | Last visit |
Googlebot | 1658+56 | 63.80 MB | 31 Jan 2011 - 23:59 |
Unknown robot (identified by 'crawl') | 5935+282 | 202.19 MB | 31 Jan 2011 - 23:46 |
Unknown robot (identified by 'discovery') | 311+34 | 25.82 MB | 31 Jan 2011 - 23:46 |
Yahoo Slurp | 823+62 | 47.76 MB | 31 Jan 2011 - 22:33 |
Unknown robot (identified by 'bot*') | 1645+243 | 38.29 MB | 31 Jan 2011 - 22:04 |
Harvest | 86 | 137.29 KB | 31 Jan 2011 - 19:56 |
BaiDuSpider | 94+23 | 479.44 KB | 31 Jan 2011 - 15:48 |
Voila | 20+11 | 42.85 KB | 31 Jan 2011 - 15:45 |
Unknown robot (identified by empty user agent string) | 22+1 | 58.61 KB | 31 Jan 2011 - 12:52 |
yacy | 11+1 | 148.65 KB | 31 Jan 2011 - 12:52 |
Unknown robot (identified by 'robot') | 29+7 | 122.23 KB | 31 Jan 2011 - 01:19 |
Jakarta commons-httpclient | 30 | 37.62 KB | 31 Jan 2011 - 00:57 |
Alexa (IA Archiver) | 1+47 | 7.49 KB | 31 Jan 2011 - 00:01 |
Yandex bot | 122+27 | 9.17 MB | 30 Jan 2011 - 07:08 |
Unknown robot (identified by hit on 'robots.txt') | 0+10 | 880 Bytes | 30 Jan 2011 - 06:02 |
Exabot | 42+8 | 199.22 KB | 29 Jan 2011 - 02:25 |
Python-urllib | 522 | 14.78 MB | 28 Jan 2011 - 00:02 |
Speedy Spider | 8+8 | 71.50 KB | 27 Jan 2011 - 22:41 |
Perl tool | 10 | 18.10 KB | 26 Jan 2011 - 20:43 |
Custo | 9+7 | 33.01 KB | 26 Jan 2011 - 14:55 |
MJ12bot | 17+2 | 127.86 KB | 26 Jan 2011 - 06:34 |
Netcraft | 1 | 3.45 KB | 25 Jan 2011 - 14:21 |
Java (Often spam bot) | 257 | 5.63 MB | 24 Jan 2011 - 01:06 |
Nutch | 23+8 | 114.30 KB | 22 Jan 2011 - 01:46 |
Spiderman | 31+1 | 1.76 MB | 18 Jan 2011 - 00:05 |
GigaBot | 1+1 | 2.89 KB | 17 Jan 2011 - 02:57 |
WGet tools | 122+1 | 6.18 MB | 14 Jan 2011 - 07:19 |
MSNBot-media | 2+1 | 12.46 KB | 07 Jan 2011 - 03:05 |
Sogou Spider | 1 | 0 | 06 Jan 2011 - 11:25 |
DoCoMo | 4+3 | 16.35 KB | 04 Jan 2011 - 19:04 |
The web archive (IA Archiver) | 0+1 | 88 Bytes | 04 Jan 2011 - 18:14 |
CFNetwork | 3 | 144.08 KB | 04 Jan 2011 - 06:53 |