| 51 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 3306+828 | 669.51 MB | 31 Oct 2006 - 23:57 |
| Unknown robot (identified by 'crawl') | 3543+528 | 85.13 MB | 31 Oct 2006 - 23:57 |
| NutchCVS | 28+9 | 1.27 MB | 31 Oct 2006 - 23:26 |
| MSNBot | 527+303 | 241.40 MB | 31 Oct 2006 - 23:20 |
| BaiDuSpider | 12+5 | 440 Bytes | 31 Oct 2006 - 21:53 |
| GigaBot | 37+32 | 295.46 KB | 31 Oct 2006 - 21:22 |
| Unknown robot (identified by empty user agent string) | 47+19 | 1.63 MB | 31 Oct 2006 - 18:17 |
| Googlebot | 751+40 | 378.16 MB | 31 Oct 2006 - 17:06 |
| Ask | 135+35 | 10.57 MB | 31 Oct 2006 - 15:58 |
| Harvest | 44 | 368.01 KB | 31 Oct 2006 - 15:36 |
| Voyager | 10+2 | 74.27 KB | 31 Oct 2006 - 10:43 |
| Unknown robot (identified by 'bot*') | 338+359 | 22.31 MB | 31 Oct 2006 - 08:58 |
| Nutch | 33+25 | 164.80 KB | 31 Oct 2006 - 06:36 |
| Jakarta commons-httpclient | 2 | 6.12 KB | 31 Oct 2006 - 06:14 |
| Java (Often spam bot) | 1062 | 5.66 MB | 30 Oct 2006 - 23:27 |
| Findlinks | 23+9 | 244.17 KB | 30 Oct 2006 - 21:57 |
| Shim-Crawler | 15+6 | 158.28 KB | 30 Oct 2006 - 21:21 |
| Netcraft | 6 | 0 | 30 Oct 2006 - 16:33 |
| Voila | 21+25 | 67.72 KB | 30 Oct 2006 - 16:32 |
| ZyBorg | 7+5 | 23.28 KB | 30 Oct 2006 - 11:37 |
| Unknown robot (identified by 'spider') | 7+7 | 27.35 KB | 30 Oct 2006 - 11:24 |
| MSNBot-media | 235+33 | 20.60 MB | 29 Oct 2006 - 11:01 |
| Openfind data gatherer | 5 | 29.85 KB | 29 Oct 2006 - 09:59 |
| Speedy Spider | 26+14 | 131.42 KB | 28 Oct 2006 - 20:58 |
| Sogou Spider | 17+5 | 3.21 MB | 28 Oct 2006 - 16:25 |
| Exabot | 13+8 | 48.62 KB | 27 Oct 2006 - 02:45 |
| Perl tool | 20 | 48.67 KB | 27 Oct 2006 - 02:03 |
| Unknown robot (identified by hit on 'robots.txt') | 0+17 | 1.46 KB | 25 Oct 2006 - 14:25 |
| ConveraCrawler | 83+1 | 997.84 KB | 25 Oct 2006 - 03:23 |
| CFNetwork | 1 | 6.73 MB | 24 Oct 2006 - 15:12 |
| Zeus Webster Pro | 2+2 | 7.81 KB | 23 Oct 2006 - 17:24 |
| ASpider (Associative Spider) | 525+4 | 2.51 MB | 22 Oct 2006 - 08:46 |
| Ocelli | 375+1 | 116.56 MB | 22 Oct 2006 - 05:29 |
| Unknown robot (identified by 'robot') | 2+2 | 4.43 KB | 21 Oct 2006 - 02:55 |
| Python-urllib | 119 | 378.33 KB | 20 Oct 2006 - 04:18 |
| LinkChecker | 168+1 | 1.31 MB | 19 Oct 2006 - 19:23 |
| HTTrack off-line browser | 10+2 | 38.39 KB | 19 Oct 2006 - 14:09 |
| psbot | 1+1 | 88 Bytes | 19 Oct 2006 - 07:02 |
| nicebot | 8+1 | 45.70 KB | 19 Oct 2006 - 03:24 |
| Holmes | 0+2 | 176 Bytes | 17 Oct 2006 - 05:03 |
| WGet tools | 2+1 | 2.52 MB | 17 Oct 2006 - 01:59 |
| Alexa (IA Archiver) | 14+6 | 120.13 KB | 16 Oct 2006 - 23:56 |
| MSRBOT | 6+6 | 15.15 KB | 15 Oct 2006 - 06:07 |
| MJ12bot | 44+4 | 321.65 KB | 15 Oct 2006 - 06:00 |
| Heritrix | 602+2 | 250.60 MB | 11 Oct 2006 - 19:10 |
| MSIECrawler | 2 | 0 | 08 Oct 2006 - 17:04 |
| Girafabot | 5+2 | 21.08 KB | 07 Oct 2006 - 13:18 |
| BecomeBot | 0+1 | 88 Bytes | 05 Oct 2006 - 15:52 |
| Unknown robot (identified by '*bot') | 0+1 | 88 Bytes | 04 Oct 2006 - 14:35 |
| Unknown robot (identified by 'discovery') | 1 | 0 | 02 Oct 2006 - 20:18 |