| 60 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 3781+854 | 467.86 MB | 30 Nov 2006 - 23:55 |
| Unknown robot (identified by 'crawl') | 3118+510 | 102.16 MB | 30 Nov 2006 - 22:52 |
| Java (Often spam bot) | 1562 | 124.15 MB | 30 Nov 2006 - 19:44 |
| Unknown robot (identified by 'bot*') | 654+21 | 10.95 MB | 29 Nov 2006 - 14:12 |
| Ask | 591+64 | 9.94 MB | 30 Nov 2006 - 22:09 |
| ASpider (Associative Spider) | 606+6 | 132.91 MB | 24 Nov 2006 - 13:29 |
| MSNBot | 370+196 | 94.90 MB | 30 Nov 2006 - 22:45 |
| Googlebot | 518+37 | 305.84 MB | 30 Nov 2006 - 22:24 |
| noxtrumbot | 492+1 | 182.44 MB | 11 Nov 2006 - 09:51 |
| WGet tools | 478+3 | 252.09 MB | 29 Nov 2006 - 10:57 |
| MSNBot-media | 424+53 | 61.41 MB | 30 Nov 2006 - 04:56 |
| Unknown robot (identified by 'robot') | 441+12 | 1.33 MB | 30 Nov 2006 - 23:45 |
| LinkChecker | 337+2 | 2.62 MB | 28 Nov 2006 - 02:16 |
| NutchCVS | 266+2 | 2.20 MB | 11 Nov 2006 - 06:08 |
| Turn It In | 245+1 | 12.08 MB | 15 Nov 2006 - 04:04 |
| Heritrix | 155+3 | 2.75 MB | 17 Nov 2006 - 08:04 |
| Voyager | 111+19 | 850.90 KB | 30 Nov 2006 - 18:54 |
| Harvest | 96 | 292.24 KB | 28 Nov 2006 - 15:36 |
| Voila | 35+44 | 158.81 KB | 30 Nov 2006 - 19:42 |
| Nutch | 47+23 | 290.76 KB | 29 Nov 2006 - 19:34 |
| HTTrack off-line browser | 41+27 | 162.40 KB | 30 Nov 2006 - 13:39 |
| ZyBorg | 40+5 | 301.16 KB | 29 Nov 2006 - 10:05 |
| Findlinks | 17+19 | 212.09 KB | 30 Nov 2006 - 17:37 |
| Unknown robot (identified by empty user agent string) | 34+1 | 3.13 MB | 30 Nov 2006 - 03:36 |
| Exabot | 22+11 | 103.07 KB | 29 Nov 2006 - 19:41 |
| BaiDuSpider | 18+7 | 616 Bytes | 29 Nov 2006 - 22:48 |
| GigaBot | 12+13 | 116.44 KB | 28 Nov 2006 - 11:28 |
| Unknown robot (identified by hit on 'robots.txt') | 0+21 | 1.63 KB | 30 Nov 2006 - 11:46 |
| MJ12bot | 16+2 | 70.56 KB | 19 Nov 2006 - 01:36 |
| Custo | 16 | 29.05 MB | 17 Nov 2006 - 01:08 |
| Perl tool | 14 | 57.81 KB | 29 Nov 2006 - 06:47 |
| psbot | 9+4 | 65.96 KB | 30 Nov 2006 - 04:22 |
| nicebot | 12+1 | 66.28 KB | 26 Nov 2006 - 19:16 |
| Unknown robot (identified by 'spider') | 6+6 | 23.44 KB | 28 Nov 2006 - 18:45 |
| Fish search | 12 | 71.01 KB | 20 Nov 2006 - 04:43 |
| BecomeBot | 5+5 | 24.75 KB | 26 Nov 2006 - 14:24 |
| Yandex bot | 5+5 | 19.54 KB | 21 Nov 2006 - 04:38 |
| MSIECrawler | 8+1 | 20.99 KB | 14 Nov 2006 - 15:29 |
| Sogou Spider | 6+3 | 1.60 MB | 28 Nov 2006 - 13:25 |
| Girafabot | 5+2 | 21.08 KB | 17 Nov 2006 - 17:44 |
| ichiro | 4+3 | 12.15 KB | 28 Nov 2006 - 21:07 |
| Openfind data gatherer | 4 | 17.93 KB | 26 Nov 2006 - 21:27 |
| Speedy Spider | 2+2 | 7.81 KB | 11 Nov 2006 - 05:40 |
| Jakarta commons-httpclient | 3 | 10.99 KB | 22 Nov 2006 - 23:19 |
| Pompos | 0+3 | 264 Bytes | 21 Nov 2006 - 17:28 |
| KnowItAll | 2+1 | 13.75 MB | 02 Nov 2006 - 23:17 |
| Netcraft | 3 | 0 | 05 Nov 2006 - 16:57 |
| Sina Iask Spider | 1+1 | 3.91 KB | 06 Nov 2006 - 03:18 |
| Krugle | 1+1 | 3.91 KB | 16 Nov 2006 - 21:46 |
| Alexa (IA Archiver) | 1+1 | 3.40 KB | 21 Nov 2006 - 15:05 |
| ConveraCrawler | 1+1 | 229 Bytes | 09 Nov 2006 - 13:50 |
| lwp-trivial | 2 | 7.14 KB | 20 Nov 2006 - 07:18 |
| IBM Almaden Research Center WebFountain™ | 0+2 | 176 Bytes | 07 Nov 2006 - 14:07 |
| WordPress | 2 | 0 | 09 Nov 2006 - 06:38 |
| Cfetch | 1 | 0 | 13 Nov 2006 - 13:01 |
| PyQuery | 1 | 8.59 KB | 12 Nov 2006 - 07:46 |
| YahooSeeker Yahoo! Blog crawler | 0+1 | 88 Bytes | 25 Nov 2006 - 00:50 |
| yacy | 0+1 | 88 Bytes | 26 Nov 2006 - 00:16 |
| Asterias | 1 | 3.82 KB | 20 Nov 2006 - 04:20 |