| 33 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 1874+21 | 140.16 MB | 31 Aug 2014 - 23:58 |
| Googlebot | 3356+545 | 687.17 MB | 31 Aug 2014 - 23:55 |
| Unknown robot (identified by 'bot*') | 1356+149 | 257.09 MB | 31 Aug 2014 - 23:38 |
| BaiDuSpider | 3937+1 | 81.78 MB | 31 Aug 2014 - 23:19 |
| Unknown robot (identified by empty user agent string) | 442 | 48.27 MB | 31 Aug 2014 - 22:27 |
| Sogou Spider | 117+30 | 7.23 MB | 31 Aug 2014 - 22:02 |
| Unknown robot (identified by hit on 'robots.txt') | 0+51 | 4.53 KB | 31 Aug 2014 - 20:48 |
| Yandex bot | 5554+72 | 504.95 MB | 31 Aug 2014 - 20:41 |
| FaceBook bot | 5 | 269.68 KB | 31 Aug 2014 - 20:20 |
| Unknown robot (identified by 'spider') | 283+26 | 13.11 MB | 31 Aug 2014 - 16:26 |
| Feedfetcher-Google | 31 | 1.40 MB | 31 Aug 2014 - 15:37 |
| Exabot | 29+7 | 1.29 MB | 31 Aug 2014 - 14:22 |
| Jakarta commons-httpclient | 63+1 | 140.80 KB | 31 Aug 2014 - 09:14 |
| archive.org bot | 3+4 | 1.45 MB | 31 Aug 2014 - 04:30 |
| MJ12bot | 19+19 | 294.05 KB | 31 Aug 2014 - 01:56 |
| Unknown robot (identified by 'crawl') | 1382+154 | 41.71 MB | 30 Aug 2014 - 23:00 |
| larbin | 38+3 | 618.08 KB | 30 Aug 2014 - 10:50 |
| Harvest | 46 | 728.00 KB | 29 Aug 2014 - 18:09 |
| Java (Often spam bot) | 361+4 | 36.29 MB | 29 Aug 2014 - 01:12 |
| Perl tool | 9 | 40.33 KB | 28 Aug 2014 - 20:50 |
| MSNBot-media | 3+9 | 416.86 KB | 28 Aug 2014 - 06:28 |
| FavIconizer | 9 | 3.81 MB | 28 Aug 2014 - 04:02 |
| Unknown robot (identified by 'robot') | 6+12 | 2.15 MB | 28 Aug 2014 - 03:29 |
| Nutch | 3+3 | 23.72 KB | 27 Aug 2014 - 05:15 |
| Sift | 2 | 40.94 KB | 27 Aug 2014 - 00:01 |
| Phantom | 2 | 2.46 KB | 26 Aug 2014 - 16:50 |
| SeznamBot | 18+7 | 445.51 KB | 26 Aug 2014 - 00:14 |
| Mail.ru bot | 11+10 | 1.39 MB | 22 Aug 2014 - 05:55 |
| MSNBot | 2+1 | 31.95 KB | 19 Aug 2014 - 13:57 |
| Heritrix | 408+1 | 11.98 MB | 18 Aug 2014 - 15:44 |
| Python-urllib | 41 | 888.34 KB | 16 Aug 2014 - 09:51 |
| Netcraft | 2 | 7.82 KB | 14 Aug 2014 - 09:06 |
| Alexa (IA Archiver) | 2+2 | 384.92 KB | 12 Aug 2014 - 21:20 |