| 33 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 5727+311 | 14.67 MB | 30 Nov 2009 - 06:54 |
| MSNBot | 759+455 | 3.45 MB | 30 Nov 2009 - 23:58 |
| Yahoo Slurp | 365+79 | 2.61 MB | 30 Nov 2009 - 23:44 |
| Googlebot | 352+29 | 3.57 MB | 30 Nov 2009 - 23:46 |
| Java (Often spam bot) | 293 | 654.00 KB | 30 Nov 2009 - 20:34 |
| Unknown robot (identified by 'bot*') | 71+15 | 478.76 KB | 30 Nov 2009 - 18:20 |
| Heritrix | 65+4 | 1.59 MB | 20 Nov 2009 - 02:49 |
| Unknown robot (identified by hit on 'robots.txt') | 0+67 | 5.76 KB | 30 Nov 2009 - 17:43 |
| BaiDuSpider | 50+13 | 152.51 KB | 30 Nov 2009 - 11:39 |
| Harvest | 56 | 77.25 KB | 29 Nov 2009 - 23:50 |
| Ask | 25+20 | 211.57 KB | 30 Nov 2009 - 08:08 |
| Unknown robot (identified by empty user agent string) | 35+5 | 277.17 KB | 30 Nov 2009 - 07:15 |
| Unknown robot (identified by 'spider') | 27+12 | 106.82 KB | 29 Nov 2009 - 00:46 |
| Exabot | 24+14 | 312.39 KB | 29 Nov 2009 - 16:53 |
| twiceler | 9+28 | 28.36 KB | 30 Nov 2009 - 05:51 |
| Speedy Spider | 14+12 | 9.16 KB | 30 Nov 2009 - 00:49 |
| larbin | 17+6 | 52.43 KB | 30 Nov 2009 - 17:34 |
| Voila | 17+5 | 183.83 KB | 29 Nov 2009 - 16:12 |
| Yandex bot | 8+7 | 25.31 KB | 30 Nov 2009 - 20:56 |
| Jakarta commons-httpclient | 14 | 106.95 KB | 30 Nov 2009 - 07:02 |
| GigaBot | 5+5 | 15.55 KB | 21 Nov 2009 - 19:10 |
| Steeler | 7+2 | 36.25 KB | 29 Nov 2009 - 21:45 |
| Turn It In | 7+2 | 60.62 KB | 26 Nov 2009 - 22:59 |
| Nutch | 3+3 | 5.17 KB | 23 Nov 2009 - 14:08 |
| Python-urllib | 5 | 281.51 KB | 25 Nov 2009 - 08:10 |
| yacy | 2+2 | 6.48 KB | 11 Nov 2009 - 06:12 |
| WebReaper | 2+2 | 6.73 KB | 26 Nov 2009 - 01:42 |
| WordPress | 4 | 880 Bytes | 26 Nov 2009 - 10:00 |
| Sogou Spider | 3 | 0 | 24 Nov 2009 - 08:27 |
| Alexa (IA Archiver) | 1+1 | 22.41 KB | 16 Nov 2009 - 16:23 |
| MJ12bot | 1+1 | 3.11 KB | 02 Nov 2009 - 04:49 |
| WGet tools | 1 | 93.48 KB | 30 Nov 2009 - 04:22 |
| Netcraft | 1 | 3.02 KB | 19 Nov 2009 - 06:24 |