33 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 5954+221 | 778.91 MB | 30 Nov 2016 - 23:49 |
Googlebot | 4646+511 | 1.72 GB | 30 Nov 2016 - 23:56 |
Yahoo Slurp | 2011+132 | 107.32 MB | 30 Nov 2016 - 23:09 |
BaiDuSpider | 1744+14 | 159.66 MB | 30 Nov 2016 - 23:01 |
Unknown robot (identified by 'crawl') | 508+26 | 26.56 MB | 28 Nov 2016 - 03:56 |
Yandex bot | 355+106 | 39.77 MB | 30 Nov 2016 - 23:30 |
Java (Often spam bot) | 376+2 | 15.83 MB | 30 Nov 2016 - 20:19 |
Sogou Spider | 196+39 | 23.23 MB | 30 Nov 2016 - 10:27 |
Unknown robot (identified by hit on 'robots.txt') | 0+132 | 11.73 KB | 30 Nov 2016 - 19:38 |
Feedfetcher-Google | 92 | 663.31 KB | 30 Nov 2016 - 21:38 |
MJ12bot | 40+34 | 516.18 KB | 30 Nov 2016 - 21:59 |
Unknown robot (identified by 'robot') | 36+25 | 3.77 MB | 30 Nov 2016 - 22:18 |
Unknown robot (identified by 'spider') | 56 | 1.96 MB | 30 Nov 2016 - 22:31 |
Heritrix | 46+1 | 1.44 MB | 24 Nov 2016 - 19:05 |
Unknown robot (identified by empty user agent string) | 33+2 | 2.65 MB | 29 Nov 2016 - 15:53 |
Harvest | 26 | 70.12 KB | 27 Nov 2016 - 17:50 |
MSNBot-media | 21 | 1.38 MB | 22 Nov 2016 - 18:08 |
Alexa (IA Archiver) | 7+12 | 143.01 KB | 17 Nov 2016 - 09:03 |
yacy | 18+1 | 2.55 MB | 27 Nov 2016 - 09:14 |
Python-urllib | 18 | 483.62 KB | 25 Nov 2016 - 15:26 |
FavIconizer | 14 | 2.38 MB | 30 Nov 2016 - 14:22 |
Web Core / Roots | 13 | 401.39 KB | 27 Nov 2016 - 01:45 |
Perl tool | 11 | 49.82 KB | 30 Nov 2016 - 18:59 |
Exabot | 5+3 | 46.25 KB | 20 Nov 2016 - 14:19 |
SeznamBot | 3+3 | 2.56 KB | 24 Nov 2016 - 12:26 |
Powermarks | 3 | 61.29 KB | 04 Nov 2016 - 11:13 |
archive.org bot | 1+2 | 8.21 KB | 29 Nov 2016 - 08:49 |
Netcraft | 3 | 16.06 KB | 17 Nov 2016 - 17:40 |
Nutch | 1+1 | 8.12 KB | 18 Nov 2016 - 18:26 |
MojeekBot | 1+1 | 8.12 KB | 06 Nov 2016 - 19:28 |
Sift | 1 | 20.68 KB | 28 Nov 2016 - 17:30 |
Unknown robot (identified by 'discovery') | 1 | 0 | 17 Nov 2016 - 09:52 |
CFNetwork | 1 | 80.00 KB | 15 Nov 2016 - 10:16 |