| 33 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 8071+396 | 16.22 MB | 30 Sep 2009 - 15:55 |
| MSNBot | 622+783 | 5.19 MB | 30 Sep 2009 - 23:59 |
| Yahoo Slurp | 351+94 | 1.05 MB | 30 Sep 2009 - 18:26 |
| Java (Often spam bot) | 281 | 640.43 KB | 30 Sep 2009 - 18:40 |
| Googlebot | 199+24 | 2.70 MB | 30 Sep 2009 - 12:09 |
| Heritrix | 108+2 | 1.93 MB | 29 Sep 2009 - 18:36 |
| Harvest | 76 | 382.36 KB | 29 Sep 2009 - 16:34 |
| BaiDuSpider | 54+20 | 186.97 KB | 28 Sep 2009 - 23:16 |
| Unknown robot (identified by hit on 'robots.txt') | 0+55 | 4.73 KB | 30 Sep 2009 - 20:01 |
| Unknown robot (identified by 'bot*') | 32+18 | 1.15 MB | 29 Sep 2009 - 11:46 |
| Ask | 22+18 | 369.98 KB | 30 Sep 2009 - 13:25 |
| twiceler | 9+21 | 27.76 KB | 30 Sep 2009 - 03:42 |
| Voila | 17+8 | 202.95 KB | 30 Sep 2009 - 17:06 |
| Speedy Spider | 12+13 | 6.22 KB | 29 Sep 2009 - 14:44 |
| Yandex bot | 9+8 | 27.91 KB | 29 Sep 2009 - 07:05 |
| Exabot | 8+8 | 704 Bytes | 22 Sep 2009 - 17:40 |
| Turn It In | 12+2 | 201.38 KB | 24 Sep 2009 - 01:26 |
| GigaBot | 7+7 | 21.77 KB | 24 Sep 2009 - 17:49 |
| Unknown robot (identified by empty user agent string) | 8+4 | 26.33 KB | 29 Sep 2009 - 03:03 |
| larbin | 6+6 | 18.66 KB | 21 Sep 2009 - 02:44 |
| Python-urllib | 11 | 657.10 KB | 29 Sep 2009 - 08:01 |
| MJ12bot | 6+4 | 25.25 KB | 27 Sep 2009 - 22:40 |
| Nutch | 3+4 | 10.52 KB | 11 Sep 2009 - 02:09 |
| Unknown robot (identified by 'discovery') | 3+3 | 9.59 KB | 29 Sep 2009 - 03:18 |
| Voyager | 0+5 | 440 Bytes | 11 Sep 2009 - 06:06 |
| psbot | 2+2 | 5.84 KB | 09 Sep 2009 - 17:06 |
| yacy | 2+2 | 6.22 KB | 28 Sep 2009 - 13:42 |
| Alexa (IA Archiver) | 2+1 | 8.42 KB | 05 Sep 2009 - 04:33 |
| Jakarta commons-httpclient | 1 | 9.83 KB | 17 Sep 2009 - 11:10 |
| Perl tool | 1 | 3.02 KB | 06 Sep 2009 - 20:43 |
| HTTrack off-line browser | 1 | 0 | 12 Sep 2009 - 14:51 |
| Netcraft | 1 | 3.02 KB | 07 Sep 2009 - 16:28 |
| Sogou Spider | 1 | 0 | 14 Sep 2009 - 04:56 |