| 39 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 503+260 | 4.85 MB | 30 Jun 2007 - 23:16 |
| Yahoo Slurp | 368+307 | 3.52 MB | 30 Jun 2007 - 23:21 |
| MSNBot | 306+239 | 2.35 MB | 30 Jun 2007 - 23:10 |
| Googlebot | 227+26 | 4.11 MB | 30 Jun 2007 - 18:23 |
| Perl tool | 170 | 654.11 KB | 14 Jun 2007 - 06:38 |
| Harvest | 125 | 428.81 KB | 30 Jun 2007 - 04:03 |
| Unknown robot (identified by 'bot*') | 103+16 | 1.83 MB | 30 Jun 2007 - 08:08 |
| Ask | 64+29 | 405.18 KB | 30 Jun 2007 - 12:55 |
| archive.org bot | 45+1 | 276.84 KB | 12 Jun 2007 - 08:56 |
| Nutch | 34+11 | 201.14 KB | 11 Jun 2007 - 02:40 |
| BecomeBot | 20+22 | 103.55 KB | 30 Jun 2007 - 21:46 |
| Voyager | 21+9 | 133.39 KB | 30 Jun 2007 - 18:45 |
| Voila | 15+15 | 132.57 KB | 30 Jun 2007 - 09:37 |
| MSNBot-media | 15+11 | 85.92 KB | 30 Jun 2007 - 17:33 |
| VWbot | 10+9 | 53.20 KB | 21 Jun 2007 - 11:17 |
| Unknown robot (identified by empty user agent string) | 5+10 | 122.00 KB | 29 Jun 2007 - 22:02 |
| Unknown robot (identified by hit on 'robots.txt') | 0+13 | 1.03 KB | 30 Jun 2007 - 16:50 |
| Findlinks | 7+4 | 17.20 KB | 28 Jun 2007 - 19:36 |
| NG 2.x (Exalead) | 7+4 | 19.69 KB | 27 Jun 2007 - 20:58 |
| Java (Often spam bot) | 7 | 110.57 KB | 20 Jun 2007 - 11:46 |
| Heritrix | 4+3 | 10.02 KB | 16 Jun 2007 - 23:01 |
| twiceler | 0+6 | 528 Bytes | 25 Jun 2007 - 00:06 |
| psbot | 3+3 | 17.97 KB | 26 Jun 2007 - 08:57 |
| WGet tools | 6 | 35.60 KB | 23 Jun 2007 - 23:17 |
| IRLbot | 5+1 | 8.59 KB | 14 Jun 2007 - 04:53 |
| YahooSeeker Yahoo! Blog crawler | 0+5 | 440 Bytes | 22 Jun 2007 - 07:38 |
| boitho.com-dc | 2+2 | 5.42 KB | 28 Jun 2007 - 02:38 |
| lwp-trivial | 4 | 193.53 KB | 12 Jun 2007 - 03:11 |
| Sogou Spider | 2+2 | 3.45 KB | 23 Jun 2007 - 11:14 |
| larbin | 1+2 | 3.20 KB | 22 Jun 2007 - 19:33 |
| MJ12bot | 2+1 | 9.79 KB | 27 Jun 2007 - 21:00 |
| Cfetch | 2 | 0 | 26 Jun 2007 - 19:46 |
| yacy | 1+1 | 3.11 KB | 23 Jun 2007 - 21:18 |
| ConveraCrawler | 1+1 | 88 Bytes | 25 Jun 2007 - 10:37 |
| GigaBot | 1+1 | 528 Bytes | 12 Jun 2007 - 15:32 |
| Speedy Spider | 1+1 | 786 Bytes | 13 Jun 2007 - 13:03 |
| Jakarta commons-httpclient | 0+1 | 88 Bytes | 01 Jun 2007 - 13:34 |
| Holmes | 0+1 | 88 Bytes | 24 Jun 2007 - 10:58 |
| Unknown robot (identified by 'robot') | 1 | 3.02 KB | 19 Jun 2007 - 13:08 |