| 32 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 8710+322 | 23.48 MB | 30 Nov 2009 - 06:52 |
| Googlebot | 1267+43 | 53.36 MB | 30 Nov 2009 - 23:41 |
| MSNBot | 531+339 | 1.61 MB | 30 Nov 2009 - 23:15 |
| Yahoo Slurp | 530+74 | 6.76 MB | 30 Nov 2009 - 23:52 |
| Java (Often spam bot) | 436 | 1.87 MB | 27 Nov 2009 - 15:18 |
| Unknown robot (identified by 'bot*') | 110+16 | 2.08 MB | 28 Nov 2009 - 17:07 |
| Heritrix | 106+4 | 9.62 MB | 20 Nov 2009 - 03:25 |
| BaiDuSpider | 70+11 | 233.00 KB | 30 Nov 2009 - 20:27 |
| Harvest | 74 | 132.29 KB | 30 Nov 2009 - 05:30 |
| Jakarta commons-httpclient | 64 | 86.03 KB | 30 Nov 2009 - 07:08 |
| Unknown robot (identified by hit on 'robots.txt') | 0+64 | 5.50 KB | 30 Nov 2009 - 17:43 |
| Ask | 36+26 | 4.03 MB | 28 Nov 2009 - 22:05 |
| Exabot | 44+17 | 2.84 MB | 29 Nov 2009 - 16:52 |
| Unknown robot (identified by 'spider') | 30+14 | 148.36 KB | 29 Nov 2009 - 00:50 |
| Unknown robot (identified by empty user agent string) | 31+6 | 3.00 MB | 28 Nov 2009 - 22:41 |
| twiceler | 9+28 | 30.15 KB | 30 Nov 2009 - 23:41 |
| Speedy Spider | 19+13 | 27.64 KB | 27 Nov 2009 - 20:03 |
| Custo | 15+14 | 43.90 KB | 30 Nov 2009 - 10:32 |
| Voila | 17+10 | 36.46 KB | 30 Nov 2009 - 06:00 |
| larbin | 16+5 | 57.92 KB | 30 Nov 2009 - 22:01 |
| Turn It In | 12+2 | 831.95 KB | 26 Nov 2009 - 04:02 |
| Yandex bot | 7+7 | 23.53 KB | 28 Nov 2009 - 08:53 |
| GigaBot | 4+4 | 13.36 KB | 20 Nov 2009 - 15:34 |
| Steeler | 5+2 | 35.46 KB | 29 Nov 2009 - 22:00 |
| WebReaper | 3+3 | 10.50 KB | 26 Nov 2009 - 01:39 |
| Python-urllib | 6 | 131.31 KB | 13 Nov 2009 - 15:15 |
| yacy | 2+2 | 6.84 KB | 11 Nov 2009 - 06:14 |
| Sogou Spider | 4 | 0 | 24 Nov 2009 - 20:09 |
| Alexa (IA Archiver) | 1+1 | 3.50 KB | 20 Nov 2009 - 05:54 |
| WGet tools | 1 | 43.12 KB | 30 Nov 2009 - 04:50 |
| Netcraft | 1 | 3.25 KB | 19 Nov 2009 - 05:08 |
| Nutch | 0+1 | 88 Bytes | 29 Nov 2009 - 18:29 |