| 35 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 1191+415 | 7.61 MB | 31 Jul 2007 - 23:32 |
| Yahoo Slurp | 1114+204 | 16.91 MB | 31 Jul 2007 - 23:08 |
| MSNBot | 251+222 | 10.13 MB | 31 Jul 2007 - 23:15 |
| Googlebot | 360+26 | 2.88 MB | 31 Jul 2007 - 20:45 |
| Heritrix | 378+4 | 29.98 MB | 23 Jul 2007 - 19:37 |
| Unknown robot (identified by 'bot*') | 163+17 | 1.51 MB | 31 Jul 2007 - 07:32 |
| Java (Often spam bot) | 112 | 496.53 KB | 18 Jul 2007 - 00:00 |
| Ask | 36+28 | 172.23 KB | 31 Jul 2007 - 03:32 |
| archive.org bot | 36+1 | 2.17 MB | 16 Jul 2007 - 20:46 |
| MSNBot-media | 21+8 | 147.54 KB | 22 Jul 2007 - 13:18 |
| Harvest | 28 | 79.70 KB | 31 Jul 2007 - 16:34 |
| Unknown robot (identified by empty user agent string) | 12+12 | 49.53 KB | 31 Jul 2007 - 03:57 |
| Alexa (IA Archiver) | 17+6 | 82.50 KB | 23 Jul 2007 - 13:36 |
| Nutch | 11+11 | 64.74 KB | 29 Jul 2007 - 19:08 |
| Voila | 10+10 | 15.62 KB | 31 Jul 2007 - 06:16 |
| Yahoo-MMCrawler | 0+12 | 1.03 KB | 30 Jul 2007 - 08:47 |
| Perl tool | 8 | 15.74 KB | 26 Jul 2007 - 08:38 |
| LinkChecker | 7+1 | 23.98 KB | 19 Jul 2007 - 16:09 |
| WGet tools | 7+1 | 133.68 KB | 26 Jul 2007 - 18:32 |
| twiceler | 0+7 | 616 Bytes | 30 Jul 2007 - 18:59 |
| Jakarta commons-httpclient | 5+1 | 545.82 KB | 29 Jul 2007 - 15:53 |
| Exabot | 3+3 | 264 Bytes | 22 Jul 2007 - 01:54 |
| BecomeBot | 3+3 | 8.75 KB | 27 Jul 2007 - 10:21 |
| larbin | 3+3 | 13.74 KB | 19 Jul 2007 - 13:29 |
| IRLbot | 6 | 20.64 KB | 15 Jul 2007 - 17:22 |
| Unknown robot (identified by hit on 'robots.txt') | 0+5 | 440 Bytes | 26 Jul 2007 - 17:16 |
| yacy | 2+2 | 3.86 KB | 02 Jul 2007 - 08:36 |
| Unknown robot (identified by 'robot') | 2+2 | 4.02 KB | 27 Jul 2007 - 02:47 |
| psbot | 2+2 | 6.50 KB | 02 Jul 2007 - 09:04 |
| Findlinks | 2+1 | 5.49 KB | 10 Jul 2007 - 23:30 |
| GigaBot | 1+2 | 625 Bytes | 25 Jul 2007 - 22:10 |
| boitho.com-dc | 1+1 | 3.50 KB | 09 Jul 2007 - 10:57 |
| ConveraCrawler | 1+1 | 88 Bytes | 10 Jul 2007 - 02:09 |
| NutchCVS | 1+1 | 3.34 KB | 15 Jul 2007 - 11:54 |
| Cfetch | 1 | 0 | 02 Jul 2007 - 07:08 |