| 45 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 111390+892 | 263.25 MB | 30 Apr 2009 - 22:10 |
| Yahoo Slurp | 3410+107 | 624.50 MB | 30 Apr 2009 - 23:52 |
| MSNBot | 1008+606 | 292.95 MB | 30 Apr 2009 - 23:48 |
| Googlebot | 712+50 | 247.09 MB | 30 Apr 2009 - 23:32 |
| Turn It In | 700+5 | 30.29 MB | 23 Apr 2009 - 23:16 |
| Unknown robot (identified by hit on 'robots.txt') | 0+567 | 48.73 KB | 30 Apr 2009 - 18:21 |
| Custo | 400+44 | 32.37 MB | 30 Apr 2009 - 12:49 |
| Ocelli | 438+1 | 136.40 MB | 09 Apr 2009 - 13:48 |
| Yandex bot | 357+16 | 115.80 MB | 28 Apr 2009 - 05:16 |
| Harvest | 356 | 255.66 KB | 30 Apr 2009 - 17:30 |
| MSNBot-media | 203+69 | 1.39 MB | 30 Apr 2009 - 22:55 |
| Ask | 208+50 | 52.13 MB | 30 Apr 2009 - 06:50 |
| Voila | 154+28 | 90.32 MB | 30 Apr 2009 - 14:07 |
| Unknown robot (identified by 'bot*') | 169+13 | 23.33 MB | 30 Apr 2009 - 09:42 |
| BaiDuSpider | 123+32 | 469.84 KB | 30 Apr 2009 - 23:04 |
| Nutch | 73+21 | 1.23 MB | 27 Apr 2009 - 15:59 |
| Unknown robot (identified by empty user agent string) | 72+17 | 5.86 MB | 30 Apr 2009 - 22:13 |
| Speedy Spider | 31+25 | 1.41 MB | 30 Apr 2009 - 08:18 |
| twiceler | 38+15 | 285.66 KB | 29 Apr 2009 - 23:24 |
| GigaBot | 26+26 | 103.09 KB | 30 Apr 2009 - 11:45 |
| Exabot | 32+18 | 285.28 KB | 29 Apr 2009 - 05:16 |
| Unknown robot (identified by 'robot') | 31+15 | 2.66 MB | 30 Apr 2009 - 17:25 |
| Voyager | 28+6 | 119.26 KB | 11 Apr 2009 - 23:42 |
| larbin | 16+16 | 62.52 KB | 30 Apr 2009 - 08:09 |
| Alexa (IA Archiver) | 18+8 | 701.52 KB | 25 Apr 2009 - 06:40 |
| MJ12bot | 19+1 | 76.40 KB | 24 Apr 2009 - 00:07 |
| Jakarta commons-httpclient | 14 | 5.00 MB | 23 Apr 2009 - 12:30 |
| Gaisbot | 9+4 | 29.07 KB | 29 Apr 2009 - 11:18 |
| Unknown robot (identified by 'spider') | 5+7 | 8.24 KB | 30 Apr 2009 - 23:46 |
| WGet tools | 11+1 | 746.57 KB | 20 Apr 2009 - 09:31 |
| Perl tool | 12 | 83.65 KB | 29 Apr 2009 - 05:17 |
| yacy | 5+6 | 12.09 KB | 18 Apr 2009 - 14:11 |
| Java (Often spam bot) | 7+1 | 1.24 MB | 27 Apr 2009 - 02:33 |
| Unknown robot (identified by 'discovery') | 4 | 15.98 KB | 02 Apr 2009 - 12:25 |
| Sogou Spider | 4 | 893.56 KB | 08 Apr 2009 - 01:44 |
| Unknown robot (identified by '*bot') | 1+1 | 3.91 KB | 01 Apr 2009 - 20:27 |
| NutchCVS | 1+1 | 3.91 KB | 18 Apr 2009 - 04:13 |
| Combine System | 1+1 | 8.38 KB | 14 Apr 2009 - 06:33 |
| Python-urllib | 2 | 2.82 MB | 27 Apr 2009 - 17:44 |
| Heritrix | 1+1 | 3.91 KB | 06 Apr 2009 - 03:34 |
| legs | 1+1 | 647.16 KB | 17 Apr 2009 - 00:22 |
| FaceBook bot | 1 | 647.08 KB | 24 Apr 2009 - 12:31 |
| HTTrack off-line browser | 0+1 | 88 Bytes | 28 Apr 2009 - 08:58 |
| Fish search | 1 | 3.82 KB | 26 Apr 2009 - 02:47 |
| Netcraft | 1 | 3.82 KB | 08 Apr 2009 - 14:09 |