| 51 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 3708+615 | 85.41 MB | 31 Mar 2008 - 23:44 |
| Yahoo Slurp | 2653+174 | 415.23 MB | 31 Mar 2008 - 23:49 |
| MSNBot | 1588+336 | 14.84 MB | 31 Mar 2008 - 23:14 |
| Googlebot | 1328+35 | 785.75 MB | 31 Mar 2008 - 23:39 |
| Heritrix | 720+4 | 472.04 MB | 27 Mar 2008 - 00:12 |
| Ask | 594+70 | 4.18 MB | 31 Mar 2008 - 21:23 |
| Java (Often spam bot) | 543+1 | 3.42 MB | 31 Mar 2008 - 11:23 |
| Unknown robot (identified by 'bot*') | 412+67 | 151.82 MB | 31 Mar 2008 - 22:59 |
| Nutch | 406+36 | 257.42 MB | 31 Mar 2008 - 17:14 |
| noxtrumbot | 383+2 | 155.17 MB | 18 Mar 2008 - 09:22 |
| Yandex bot | 287+11 | 146.84 MB | 15 Mar 2008 - 13:36 |
| Ocelli | 276+1 | 1.65 MB | 18 Mar 2008 - 07:45 |
| Voila | 108+133 | 59.85 MB | 31 Mar 2008 - 21:10 |
| BaiDuSpider | 141+37 | 465.90 KB | 31 Mar 2008 - 22:04 |
| Unknown robot (identified by hit on 'robots.txt') | 0+110 | 5.67 KB | 31 Mar 2008 - 21:55 |
| Unknown robot (identified by empty user agent string) | 61+21 | 707.23 KB | 31 Mar 2008 - 16:35 |
| MSNBot-media | 38+27 | 181.65 KB | 30 Mar 2008 - 04:41 |
| Harvest | 60 | 324.99 KB | 31 Mar 2008 - 15:30 |
| Speedy Spider | 27+20 | 1.37 MB | 31 Mar 2008 - 04:05 |
| Unknown robot (identified by 'robot') | 23+9 | 93.16 KB | 26 Mar 2008 - 18:30 |
| Exabot | 18+5 | 77.34 KB | 31 Mar 2008 - 02:49 |
| Alexa (IA Archiver) | 16+7 | 98.25 KB | 29 Mar 2008 - 03:46 |
| BecomeBot | 11+11 | 72.22 KB | 26 Mar 2008 - 07:14 |
| Python-urllib | 22 | 308.04 KB | 24 Mar 2008 - 22:00 |
| GigaBot | 8+7 | 30.25 KB | 31 Mar 2008 - 11:34 |
| Turn It In | 12+2 | 36.38 KB | 30 Mar 2008 - 13:02 |
| twiceler | 0+13 | 1.12 KB | 31 Mar 2008 - 02:48 |
| psbot | 5+5 | 27.45 KB | 27 Mar 2008 - 21:24 |
| Unknown robot (identified by 'spider') | 2+6 | 8.16 KB | 30 Mar 2008 - 00:36 |
| boitho.com-dc | 4+2 | 19.96 KB | 25 Mar 2008 - 16:08 |
| BSpider | 2+4 | 7.39 KB | 28 Mar 2008 - 12:37 |
| Holmes | 1+4 | 4.17 KB | 28 Mar 2008 - 14:59 |
| yacy | 2+3 | 7.39 KB | 30 Mar 2008 - 10:39 |
| EasyDL | 4 | 20.71 KB | 23 Mar 2008 - 22:29 |
| YahooSeeker Yahoo! Blog crawler | 0+4 | 352 Bytes | 31 Mar 2008 - 03:48 |
| Gaisbot | 2+2 | 10.81 KB | 22 Mar 2008 - 12:30 |
| Perl tool | 4 | 14.34 KB | 11 Mar 2008 - 14:27 |
| larbin | 2+2 | 9.31 KB | 22 Mar 2008 - 15:03 |
| Sogou Spider | 3+1 | 654.81 KB | 31 Mar 2008 - 11:25 |
| OutfoxBot/YodaoBot | 2+1 | 88 Bytes | 27 Mar 2008 - 16:59 |
| WGet tools | 2+1 | 584.34 KB | 28 Mar 2008 - 15:31 |
| T-H-U-N-D-E-R-S-T-O-N-E | 1+1 | 3.91 KB | 09 Mar 2008 - 00:32 |
| Grub.org | 1+1 | 3.91 KB | 29 Mar 2008 - 02:57 |
| MJ12bot | 1+1 | 3.91 KB | 02 Mar 2008 - 15:46 |
| MSIECrawler | 0+2 | 176 Bytes | 31 Mar 2008 - 12:45 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 18 Mar 2008 - 13:29 |
| Custo | 1 | 353.18 KB | 18 Mar 2008 - 07:25 |
| HTMLParser | 1 | 3.82 KB | 26 Mar 2008 - 03:07 |
| lwp-trivial | 1 | 2.88 KB | 14 Mar 2008 - 04:13 |
| QihooBot | 1 | 3.82 KB | 12 Mar 2008 - 17:48 |
| IRLbot | 0+1 | 88 Bytes | 06 Mar 2008 - 18:19 |