40 different robots | Hits | Bandwidth | Last visit |
Googlebot | 4481+636 | 882.86 MB | 31 Oct 2013 - 23:56 |
BaiDuSpider | 4616+3 | 110.58 MB | 31 Oct 2013 - 23:52 |
Unknown robot (identified by 'bot*') | 2054+229 | 134.59 MB | 31 Oct 2013 - 22:08 |
Unknown robot (identified by 'robot') | 1355+8 | 38.31 MB | 28 Oct 2013 - 21:02 |
Unknown robot (identified by 'crawl') | 852+3 | 10.40 MB | 28 Oct 2013 - 11:16 |
Mail.ru bot | 428+86 | 237.41 MB | 31 Oct 2013 - 11:08 |
MSNBot | 334+33 | 4.53 MB | 31 Oct 2013 - 20:57 |
Nutch | 298+6 | 15.70 MB | 31 Oct 2013 - 17:35 |
Sogou Spider | 148+33 | 12.13 MB | 31 Oct 2013 - 10:10 |
Yandex bot | 116+46 | 10.56 MB | 31 Oct 2013 - 07:37 |
Unknown robot (identified by 'spider') | 113+33 | 2.93 MB | 31 Oct 2013 - 22:48 |
Harvest | 94 | 109.88 KB | 31 Oct 2013 - 05:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+62 | 5.51 KB | 31 Oct 2013 - 23:52 |
MSNBot-media | 26+34 | 1.05 MB | 31 Oct 2013 - 18:04 |
Jakarta commons-httpclient | 54 | 158.75 KB | 31 Oct 2013 - 10:15 |
Java (Often spam bot) | 40 | 8.12 MB | 20 Oct 2013 - 21:03 |
SeznamBot | 25+10 | 373.79 KB | 29 Oct 2013 - 08:11 |
Unknown robot (identified by 'checker') | 35 | 16.44 KB | 15 Oct 2013 - 10:27 |
Feedfetcher-Google | 30 | 1.35 MB | 31 Oct 2013 - 08:36 |
Unknown robot (identified by empty user agent string) | 24 | 1.52 MB | 28 Oct 2013 - 14:10 |
Unknown robot (identified by '*bot') | 4+13 | 300.84 KB | 31 Oct 2013 - 10:09 |
Web Core / Roots | 17 | 1.25 MB | 06 Oct 2013 - 03:27 |
Heritrix | 12+2 | 291.38 KB | 05 Oct 2013 - 04:31 |
Alexa (IA Archiver) | 8+5 | 163.57 KB | 26 Oct 2013 - 20:10 |
ichiro | 11+1 | 177.63 KB | 14 Oct 2013 - 23:46 |
yacy | 9+1 | 1.79 MB | 11 Oct 2013 - 07:01 |
Perl tool | 10 | 40.64 KB | 31 Oct 2013 - 20:34 |
MJ12bot | 5+5 | 39.53 KB | 25 Oct 2013 - 02:29 |
FaceBook bot | 6 | 622.78 KB | 18 Oct 2013 - 20:16 |
Exabot | 3+2 | 15.12 KB | 31 Oct 2013 - 14:04 |
WordPress | 4 | 0 | 02 Oct 2013 - 14:04 |
BSpider | 1+2 | 213.11 KB | 30 Oct 2013 - 01:56 |
WebCollage | 3 | 310.79 KB | 23 Oct 2013 - 16:05 |
larbin | 2+1 | 14.14 KB | 04 Oct 2013 - 01:02 |
Netcraft | 3 | 7.82 KB | 11 Oct 2013 - 10:08 |
Python-urllib | 2 | 1.41 MB | 10 Oct 2013 - 19:03 |
Powermarks | 1 | 7.82 KB | 08 Oct 2013 - 17:03 |
Phantom | 1 | 300.39 KB | 16 Oct 2013 - 19:40 |
WGet tools | 1 | 7.82 KB | 08 Oct 2013 - 19:42 |
archive.org bot | 0+1 | 91 Bytes | 29 Oct 2013 - 05:04 |