| 31 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 10108+21 | 333.70 MB | 29 Mar 2016 - 03:38 |
| Unknown robot (identified by 'bot*') | 8706+299 | 2.22 GB | 31 Mar 2016 - 23:56 |
| Googlebot | 4019+520 | 1.59 GB | 31 Mar 2016 - 23:59 |
| Yahoo Slurp | 3420+121 | 184.20 MB | 31 Mar 2016 - 23:56 |
| Yandex bot | 1473+55 | 1.62 GB | 31 Mar 2016 - 18:38 |
| Java (Often spam bot) | 785+1 | 15.30 MB | 31 Mar 2016 - 21:34 |
| BaiDuSpider | 586+10 | 77.31 MB | 31 Mar 2016 - 23:42 |
| Unknown robot (identified by 'robot') | 379+10 | 7.83 MB | 29 Mar 2016 - 18:54 |
| Feedfetcher-Google | 155 | 2.05 MB | 31 Mar 2016 - 23:34 |
| Sogou Spider | 129+23 | 7.21 MB | 31 Mar 2016 - 19:35 |
| Unknown robot (identified by 'spider') | 81+14 | 10.00 MB | 31 Mar 2016 - 16:40 |
| Unknown robot (identified by hit on 'robots.txt') | 0+67 | 5.95 KB | 31 Mar 2016 - 20:51 |
| Jakarta commons-httpclient | 62 | 140.71 KB | 31 Mar 2016 - 09:16 |
| Unknown robot (identified by empty user agent string) | 40+6 | 696.31 KB | 31 Mar 2016 - 00:25 |
| yacy | 34 | 8.39 MB | 31 Mar 2016 - 07:56 |
| Harvest | 28 | 74.66 KB | 31 Mar 2016 - 21:52 |
| Heritrix | 22+2 | 2.15 MB | 14 Mar 2016 - 15:19 |
| archive.org bot | 13+11 | 587.56 KB | 21 Mar 2016 - 13:36 |
| Exabot | 14+8 | 233.03 KB | 28 Mar 2016 - 17:03 |
| FavIconizer | 21 | 22.49 MB | 31 Mar 2016 - 12:37 |
| Turn It In | 18+2 | 1.78 MB | 11 Mar 2016 - 05:59 |
| Python-urllib | 16 | 4.30 MB | 30 Mar 2016 - 16:15 |
| Nutch | 9+6 | 169.61 KB | 17 Mar 2016 - 19:27 |
| MJ12bot | 7+7 | 251.69 KB | 22 Mar 2016 - 21:11 |
| Perl tool | 9 | 33.76 KB | 31 Mar 2016 - 21:52 |
| HTTrack off-line browser | 5 | 138.62 KB | 29 Mar 2016 - 18:39 |
| Alexa (IA Archiver) | 2+2 | 38.53 KB | 14 Mar 2016 - 20:17 |
| Mail.ru bot | 2+2 | 8.21 KB | 31 Mar 2016 - 09:59 |
| CsCrawler | 1+1 | 8.12 KB | 14 Mar 2016 - 20:25 |
| Netcraft | 2 | 8.03 KB | 08 Mar 2016 - 18:14 |
| MSNBot-media | 1 | 18.47 KB | 11 Mar 2016 - 14:24 |