| 36 different robots | Hits | Bandwidth | Last visit |
|---|
| NutchCVS | 2+3 | 6.76 KB | 31 Oct 2006 - 23:46 |
| Java (Often spam bot) | 2074 | 8.75 MB | 31 Oct 2006 - 23:43 |
| MSNBot | 172+161 | 7.98 MB | 31 Oct 2006 - 23:25 |
| Unknown robot (identified by 'crawl') | 1224+399 | 7.58 MB | 31 Oct 2006 - 23:12 |
| Yahoo Slurp | 246+227 | 9.79 MB | 31 Oct 2006 - 21:28 |
| ZyBorg | 114+5 | 442.25 KB | 31 Oct 2006 - 18:41 |
| Googlebot | 199+27 | 2.10 MB | 31 Oct 2006 - 18:26 |
| Voyager | 1+2 | 3.58 KB | 31 Oct 2006 - 17:05 |
| Harvest | 26 | 58.99 KB | 31 Oct 2006 - 15:34 |
| Unknown robot (identified by empty user agent string) | 3+25 | 132.97 KB | 31 Oct 2006 - 10:08 |
| Findlinks | 30+9 | 239.28 KB | 31 Oct 2006 - 09:47 |
| Ask | 7+9 | 23.54 KB | 31 Oct 2006 - 09:46 |
| Unknown robot (identified by 'bot*') | 131+9 | 6.88 MB | 31 Oct 2006 - 08:52 |
| MSNBot-media | 46+15 | 269.49 KB | 31 Oct 2006 - 01:30 |
| Netcraft | 6 | 0 | 30 Oct 2006 - 21:13 |
| Exabot | 3+3 | 9.19 KB | 30 Oct 2006 - 03:01 |
| Shim-Crawler | 33+7 | 177.49 KB | 26 Oct 2006 - 04:58 |
| Perl tool | 12 | 73.03 KB | 25 Oct 2006 - 06:34 |
| Sogou Spider | 13+4 | 89.71 KB | 24 Oct 2006 - 21:09 |
| Unknown robot (identified by hit on 'robots.txt') | 0+5 | 440 Bytes | 23 Oct 2006 - 05:30 |
| Nutch | 3+3 | 10.34 KB | 22 Oct 2006 - 02:44 |
| BaiDuSpider | 2+2 | 6.68 KB | 21 Oct 2006 - 16:05 |
| Voila | 4+4 | 7.73 KB | 21 Oct 2006 - 04:50 |
| Unknown robot (identified by 'robot') | 1+1 | 3.34 KB | 21 Oct 2006 - 03:15 |
| GigaBot | 2+2 | 10.43 KB | 20 Oct 2006 - 14:46 |
| Python-urllib | 36 | 78.24 KB | 20 Oct 2006 - 04:22 |
| LinkChecker | 60+1 | 366.79 KB | 19 Oct 2006 - 17:08 |
| HTTrack off-line browser | 1+1 | 3.34 KB | 19 Oct 2006 - 14:09 |
| Turn It In | 19+1 | 119.37 KB | 14 Oct 2006 - 01:57 |
| MSRBOT | 4+4 | 10.86 KB | 13 Oct 2006 - 13:45 |
| MJ12bot | 13+2 | 64.71 KB | 13 Oct 2006 - 11:03 |
| Alexa (IA Archiver) | 5+3 | 11.21 KB | 10 Oct 2006 - 02:59 |
| WGet tools | 0+1 | 0 | 09 Oct 2006 - 13:42 |
| Yahoo-MMCrawler | 0+4 | 352 Bytes | 09 Oct 2006 - 02:44 |
| Heritrix | 131+2 | 9.59 MB | 04 Oct 2006 - 02:32 |
| ConveraCrawler | 1+1 | 88 Bytes | 02 Oct 2006 - 09:27 |