29 different robots | Hits | Bandwidth | Last visit |
Googlebot | 4321+593 | 575.53 MB | 30 Nov 2013 - 23:54 |
Sogou Spider | 1131+67 | 83.99 MB | 30 Nov 2013 - 23:43 |
Unknown robot (identified by 'bot*') | 1997+238 | 207.17 MB | 30 Nov 2013 - 23:32 |
Unknown robot (identified by hit on 'robots.txt') | 0+101 | 8.98 KB | 30 Nov 2013 - 23:18 |
Unknown robot (identified by 'spider') | 166+28 | 4.07 MB | 30 Nov 2013 - 20:50 |
Mail.ru bot | 7+8 | 35.92 MB | 30 Nov 2013 - 20:40 |
MSNBot | 283+30 | 4.01 MB | 30 Nov 2013 - 20:18 |
Yandex bot | 381+47 | 55.33 MB | 30 Nov 2013 - 17:57 |
BaiDuSpider | 4801+3 | 84.94 MB | 30 Nov 2013 - 17:39 |
Unknown robot (identified by empty user agent string) | 25 | 13.43 MB | 30 Nov 2013 - 10:41 |
Jakarta commons-httpclient | 56 | 127.09 KB | 30 Nov 2013 - 09:13 |
Feedfetcher-Google | 30 | 1.35 MB | 30 Nov 2013 - 07:38 |
Harvest | 86 | 700.80 KB | 30 Nov 2013 - 04:14 |
MSNBot-media | 10+21 | 13.36 KB | 29 Nov 2013 - 20:44 |
Unknown robot (identified by 'crawl') | 1458+7 | 19.08 MB | 29 Nov 2013 - 20:42 |
SeznamBot | 25+10 | 365.95 KB | 29 Nov 2013 - 19:21 |
Java (Often spam bot) | 240 | 7.02 MB | 29 Nov 2013 - 04:39 |
Perl tool | 8 | 32.51 KB | 28 Nov 2013 - 19:46 |
Unknown robot (identified by '*bot') | 2+4 | 15.99 KB | 28 Nov 2013 - 19:29 |
Exabot | 14+7 | 143.74 KB | 28 Nov 2013 - 06:49 |
Alexa (IA Archiver) | 2+1 | 17.62 KB | 28 Nov 2013 - 06:37 |
archive.org bot | 5+5 | 92.57 KB | 27 Nov 2013 - 22:21 |
Unknown robot (identified by 'robot') | 18+4 | 478.74 KB | 24 Nov 2013 - 05:54 |
MJ12bot | 1+1 | 7.91 KB | 18 Nov 2013 - 02:20 |
Nutch | 331+49 | 15.31 MB | 17 Nov 2013 - 07:16 |
Python-urllib | 1+1 | 724.07 KB | 13 Nov 2013 - 12:04 |
Netcraft | 2 | 7.82 KB | 10 Nov 2013 - 13:24 |
yacy | 4 | 895.41 KB | 10 Nov 2013 - 06:26 |
BSpider | 1 | 212.94 KB | 06 Nov 2013 - 11:54 |