38 different robots | Hits | Bandwidth | Last visit |
Yandex bot | 499+42 | 250.55 MB | 28 Feb 2014 - 23:56 |
Googlebot | 5571+570 | 823.77 MB | 28 Feb 2014 - 23:46 |
BaiDuSpider | 3726+3 | 95.39 MB | 28 Feb 2014 - 23:34 |
Yahoo Slurp | 1282+90 | 137.96 MB | 28 Feb 2014 - 23:32 |
Unknown robot (identified by 'crawl') | 2168+714 | 42.64 MB | 28 Feb 2014 - 23:09 |
Unknown robot (identified by 'bot*') | 1350+210 | 217.24 MB | 28 Feb 2014 - 22:53 |
Harvest | 32 | 77.31 KB | 28 Feb 2014 - 16:32 |
Unknown robot (identified by 'spider') | 87+11 | 2.18 MB | 28 Feb 2014 - 13:08 |
Java (Often spam bot) | 635+5 | 52.47 MB | 28 Feb 2014 - 11:43 |
Mail.ru bot | 156+79 | 64.99 MB | 28 Feb 2014 - 10:40 |
Unknown robot (identified by empty user agent string) | 95 | 9.17 MB | 28 Feb 2014 - 09:40 |
Jakarta commons-httpclient | 67 | 1.99 MB | 28 Feb 2014 - 09:16 |
Feedfetcher-Google | 28 | 1.26 MB | 28 Feb 2014 - 07:44 |
MJ12bot | 25+25 | 262.58 KB | 28 Feb 2014 - 05:35 |
Sogou Spider | 121+29 | 12.77 MB | 28 Feb 2014 - 03:06 |
MSNBot | 214+30 | 3.17 MB | 28 Feb 2014 - 02:58 |
FaceBook bot | 13 | 806.20 KB | 28 Feb 2014 - 00:34 |
Unknown robot (identified by hit on 'robots.txt') | 0+150 | 13.33 KB | 27 Feb 2014 - 23:58 |
Python-urllib | 1 | 7.82 KB | 27 Feb 2014 - 19:56 |
SeznamBot | 8+4 | 158.81 KB | 27 Feb 2014 - 18:34 |
Exabot | 17+8 | 197.23 KB | 27 Feb 2014 - 05:15 |
FavIconizer | 7 | 54.71 KB | 26 Feb 2014 - 16:56 |
legs | 6+6 | 47.43 KB | 25 Feb 2014 - 08:15 |
Y!J Yahoo Japan | 1+1 | 19.14 KB | 24 Feb 2014 - 15:15 |
Nutch | 462+30 | 15.52 MB | 23 Feb 2014 - 19:34 |
Motor | 1 | 171.80 KB | 23 Feb 2014 - 15:50 |
Unknown robot (identified by 'robot') | 19+4 | 445.03 KB | 20 Feb 2014 - 23:37 |
WGet tools | 1 | 0 | 20 Feb 2014 - 06:57 |
Unknown robot (identified by 'checker') | 1 | 7.82 KB | 20 Feb 2014 - 05:53 |
NG 1.x (Exalead) | 4 | 83.66 KB | 19 Feb 2014 - 18:29 |
MSNBot-media | 9+12 | 784.14 KB | 19 Feb 2014 - 13:02 |
Alexa (IA Archiver) | 1+1 | 20.08 KB | 18 Feb 2014 - 14:41 |
yacy | 14 | 1.76 MB | 16 Feb 2014 - 17:10 |
archive.org bot | 1+1 | 2.13 MB | 09 Feb 2014 - 16:19 |
Heritrix | 47+1 | 6.36 MB | 08 Feb 2014 - 16:25 |
Netcraft | 2 | 7.82 KB | 08 Feb 2014 - 13:01 |
Unknown robot (identified by 'discovery') | 2 | 15.63 KB | 07 Feb 2014 - 03:19 |
BSpider | 1+1 | 7.91 KB | 01 Feb 2014 - 14:38 |