| 29 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 10748+12 | 329.69 MB | 29 Dec 2016 - 05:59 |
| Unknown robot (identified by 'bot*') | 8524+126 | 864.84 MB | 31 Dec 2016 - 23:59 |
| Googlebot | 3584+448 | 1.94 GB | 31 Dec 2016 - 23:38 |
| Yahoo Slurp | 1982+54 | 108.05 MB | 31 Dec 2016 - 23:44 |
| BaiDuSpider | 1448+10 | 125.94 MB | 31 Dec 2016 - 23:59 |
| Yandex bot | 922+139 | 119.44 MB | 31 Dec 2016 - 23:08 |
| Web Core / Roots | 901 | 26.15 MB | 22 Dec 2016 - 23:21 |
| MJ12bot | 289+52 | 5.40 MB | 31 Dec 2016 - 00:58 |
| Java (Often spam bot) | 286 | 3.70 MB | 31 Dec 2016 - 23:11 |
| Sogou Spider | 163+41 | 10.73 MB | 31 Dec 2016 - 08:04 |
| Unknown robot (identified by hit on 'robots.txt') | 0+172 | 15.29 KB | 31 Dec 2016 - 23:57 |
| Feedfetcher-Google | 124 | 1.97 MB | 31 Dec 2016 - 21:40 |
| Unknown robot (identified by 'spider') | 93+1 | 7.89 MB | 31 Dec 2016 - 01:33 |
| Unknown robot (identified by 'robot') | 43+31 | 3.43 MB | 31 Dec 2016 - 04:19 |
| Harvest | 30 | 81.97 KB | 30 Dec 2016 - 15:45 |
| Unknown robot (identified by empty user agent string) | 25+2 | 2.09 MB | 30 Dec 2016 - 09:57 |
| yacy | 18+1 | 2.65 MB | 27 Dec 2016 - 17:02 |
| Alexa (IA Archiver) | 6+11 | 68.20 KB | 23 Dec 2016 - 17:03 |
| Phantom | 17 | 1.17 MB | 29 Dec 2016 - 18:31 |
| FavIconizer | 15 | 252.43 KB | 30 Dec 2016 - 13:31 |
| Exabot | 9+5 | 164.41 KB | 30 Dec 2016 - 23:43 |
| MSNBot-media | 13 | 1.03 MB | 27 Dec 2016 - 01:39 |
| SeznamBot | 6+5 | 732.81 KB | 30 Dec 2016 - 19:27 |
| Perl tool | 10 | 49.49 KB | 29 Dec 2016 - 20:27 |
| Netcraft | 3 | 8.03 KB | 11 Dec 2016 - 02:20 |
| Python-urllib | 2 | 668.97 KB | 28 Dec 2016 - 15:57 |
| archive.org bot | 1+1 | 1.40 MB | 06 Dec 2016 - 06:32 |
| CFNetwork | 2 | 1021.93 KB | 29 Dec 2016 - 00:33 |
| Sift | 1 | 20.68 KB | 02 Dec 2016 - 16:51 |