| 35 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 3205+404 | 27.84 MB | 30 Sep 2005 - 22:42 |
| Googlebot | 376+51 | 5.71 MB | 30 Sep 2005 - 19:36 |
| Harvest | 1724 | 34.91 MB | 30 Sep 2005 - 19:11 |
| Ask | 15+2 | 126.72 KB | 30 Sep 2005 - 15:02 |
| MSNBot | 250+102 | 2.91 MB | 30 Sep 2005 - 11:21 |
| MJ12bot | 12+1 | 59.02 KB | 30 Sep 2005 - 10:34 |
| Java (Often spam bot) | 344+3 | 1.81 MB | 30 Sep 2005 - 07:20 |
| Perl tool | 5 | 25.01 KB | 29 Sep 2005 - 06:01 |
| Findlinks | 1+2 | 3.20 KB | 29 Sep 2005 - 04:30 |
| Yahoo Slurp | 19+18 | 77.38 KB | 28 Sep 2005 - 23:55 |
| Grub.org | 24 | 131.19 KB | 28 Sep 2005 - 19:07 |
| IBM Almaden Research Center WebFountain™ | 41+8 | 334.93 KB | 28 Sep 2005 - 13:05 |
| sohu-search | 5+5 | 15.55 KB | 27 Sep 2005 - 21:08 |
| twiceler | 0+1 | 88 Bytes | 27 Sep 2005 - 02:25 |
| nicebot | 2+1 | 8.89 KB | 23 Sep 2005 - 16:48 |
| Unknown robot (identified by hit on 'robots.txt') | 0+2 | 176 Bytes | 23 Sep 2005 - 06:31 |
| boitho.com-dc | 0+1 | 88 Bytes | 22 Sep 2005 - 20:32 |
| Unknown robot (identified by 'bot*') | 8+6 | 24.71 KB | 21 Sep 2005 - 07:32 |
| NutchCVS | 22+9 | 104.47 KB | 21 Sep 2005 - 06:16 |
| BaiDuSpider | 4+2 | 9.67 KB | 20 Sep 2005 - 20:04 |
| Jakarta commons-httpclient | 16 | 87.54 KB | 18 Sep 2005 - 19:46 |
| Python-urllib | 30 | 268.12 KB | 17 Sep 2005 - 05:20 |
| BecomeBot | 2+2 | 6.22 KB | 16 Sep 2005 - 09:58 |
| Unknown robot (identified by empty user agent string) | 5 | 100.90 KB | 16 Sep 2005 - 01:12 |
| Alexa (IA Archiver) | 2+6 | 3.81 KB | 15 Sep 2005 - 04:07 |
| MSIECrawler | 0+1 | 88 Bytes | 14 Sep 2005 - 11:01 |
| psbot | 2+2 | 6.02 KB | 14 Sep 2005 - 05:00 |
| ConveraCrawler | 10+1 | 58.21 KB | 13 Sep 2005 - 23:43 |
| Voila | 1+1 | 3.11 KB | 11 Sep 2005 - 02:53 |
| updated | 13+11 | 32.48 KB | 07 Sep 2005 - 13:22 |
| Walhello appie | 0+1 | 88 Bytes | 05 Sep 2005 - 20:33 |
| Heritrix | 56+1 | 1.54 MB | 04 Sep 2005 - 06:20 |
| Cfetch | 2+1 | 6.39 KB | 03 Sep 2005 - 03:24 |
| MSRBOT | 2+1 | 3.54 KB | 02 Sep 2005 - 08:47 |
| Others | 0 | 2 Bytes | |