| 31 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 147450+6363 | 1.67 GB | 29 Feb 2012 - 23:57 |
| Googlebot | 4609+47 | 431.69 MB | 29 Feb 2012 - 23:59 |
| Heritrix | 4252+1 | 280.78 MB | 29 Feb 2012 - 15:56 |
| archive.org bot | 4245+6 | 68.57 MB | 09 Feb 2012 - 05:58 |
| Unknown robot (identified by 'bot*') | 1794+243 | 94.95 MB | 29 Feb 2012 - 20:23 |
| Yandex bot | 396+39 | 19.76 MB | 29 Feb 2012 - 11:57 |
| MSNBot | 394+2 | 7.94 MB | 29 Feb 2012 - 05:24 |
| BaiDuSpider | 137+31 | 1.13 MB | 29 Feb 2012 - 22:42 |
| Unknown robot (identified by '*bot') | 51+74 | 1.05 MB | 23 Feb 2012 - 12:02 |
| GigaBot | 75+25 | 1.21 MB | 26 Feb 2012 - 23:32 |
| Unknown robot (identified by 'discovery') | 36+35 | 6.46 MB | 29 Feb 2012 - 12:05 |
| Sogou Spider | 63+2 | 28.28 MB | 29 Feb 2012 - 19:10 |
| Jakarta commons-httpclient | 62 | 137.12 KB | 29 Feb 2012 - 09:14 |
| Nutch | 45+16 | 636.82 KB | 24 Feb 2012 - 00:57 |
| Java (Often spam bot) | 57 | 1.35 MB | 23 Feb 2012 - 12:24 |
| Feedfetcher-Google | 55 | 415.45 KB | 07 Feb 2012 - 19:08 |
| Unknown robot (identified by 'robot') | 49+2 | 56.68 MB | 29 Feb 2012 - 03:41 |
| Unknown robot (identified by empty user agent string) | 23+10 | 4.13 MB | 28 Feb 2012 - 23:44 |
| Unknown robot (identified by hit on 'robots.txt') | 0+25 | 775 Bytes | 29 Feb 2012 - 17:45 |
| Unknown robot (identified by 'spider') | 22+1 | 2.20 MB | 29 Feb 2012 - 04:13 |
| bender focused_crawler | 11+4 | 15.80 MB | 08 Feb 2012 - 16:25 |
| yacy | 6+1 | 131.01 KB | 07 Feb 2012 - 02:45 |
| Exabot | 3+3 | 28.03 KB | 27 Feb 2012 - 18:01 |
| Alexa (IA Archiver) | 3+3 | 43.06 KB | 28 Feb 2012 - 12:15 |
| Powermarks | 5 | 74.39 KB | 13 Feb 2012 - 19:20 |
| Motor | 3 | 2.93 MB | 05 Feb 2012 - 11:31 |
| Mail.ru bot | 1+2 | 6.62 KB | 19 Feb 2012 - 13:58 |
| Netcraft | 3 | 13.12 KB | 29 Feb 2012 - 14:18 |
| ichiro | 3 | 114.39 KB | 07 Feb 2012 - 23:27 |
| Perl tool | 2 | 13.12 KB | 02 Feb 2012 - 22:34 |
| NG 1.x (Exalead) | 1 | 16.47 KB | 15 Feb 2012 - 14:12 |