32 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 70988+5628 | 1.09 GB | 29 Sep 2012 - 11:42 |
Googlebot | 4877+39 | 670.63 MB | 30 Sep 2012 - 23:48 |
BaiDuSpider | 3869+53 | 76.09 MB | 30 Sep 2012 - 23:56 |
Yandex bot | 3068+62 | 351.91 MB | 30 Sep 2012 - 23:25 |
Unknown robot (identified by 'bot*') | 1793+289 | 479.03 MB | 30 Sep 2012 - 22:39 |
Unknown robot (identified by 'spider') | 797+8 | 34.89 MB | 30 Sep 2012 - 16:21 |
Unknown robot (identified by 'discovery') | 798+7 | 274.92 MB | 17 Sep 2012 - 09:29 |
MSNBot | 636+8 | 16.47 MB | 30 Sep 2012 - 08:37 |
Java (Often spam bot) | 618+10 | 246.83 MB | 30 Sep 2012 - 21:50 |
Unknown robot (identified by empty user agent string) | 63+106 | 22.73 MB | 30 Sep 2012 - 23:10 |
Sogou Spider | 143+1 | 3.46 MB | 29 Sep 2012 - 14:49 |
legs | 69+41 | 1.66 MB | 06 Sep 2012 - 12:53 |
Jakarta commons-httpclient | 60 | 128.70 KB | 30 Sep 2012 - 09:30 |
Unknown robot (identified by hit on 'robots.txt') | 0+56 | 1.70 KB | 30 Sep 2012 - 16:07 |
Mail.ru bot | 10+13 | 7.01 MB | 28 Sep 2012 - 12:40 |
Nutch | 8+9 | 46.53 KB | 26 Sep 2012 - 01:08 |
Exabot | 8+8 | 115.20 KB | 30 Sep 2012 - 14:55 |
Unknown robot (identified by 'robot') | 14+2 | 3.31 MB | 30 Sep 2012 - 07:17 |
DoCoMo | 5+4 | 270.96 KB | 15 Sep 2012 - 14:44 |
Perl tool | 8 | 27.01 KB | 27 Sep 2012 - 18:59 |
yacy | 6 | 1.16 MB | 24 Sep 2012 - 18:43 |
SeznamBot | 2+2 | 600.84 KB | 26 Sep 2012 - 14:28 |
Heritrix | 3+1 | 114.15 KB | 02 Sep 2012 - 12:19 |
Harvest | 4 | 9.04 KB | 11 Sep 2012 - 09:34 |
Unknown robot (identified by '*bot') | 1+2 | 6.53 KB | 19 Sep 2012 - 08:25 |
HTMLParser | 2 | 26.53 KB | 09 Sep 2012 - 11:55 |
Alexa (IA Archiver) | 1+1 | 18.05 KB | 11 Sep 2012 - 01:23 |
archive.org bot | 1+1 | 4.16 MB | 04 Sep 2012 - 17:17 |
MJ12bot | 1+1 | 17.02 KB | 22 Sep 2012 - 06:35 |
Netcraft | 2 | 6.47 KB | 08 Sep 2012 - 23:42 |
CFNetwork | 1 | 126.26 KB | 14 Sep 2012 - 04:46 |
Python-urllib | 0+1 | 31 Bytes | 05 Sep 2012 - 11:46 |