| 51 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 3320+134 | 540.95 MB | 31 Aug 2008 - 23:57 |
| MSNBot | 2154+544 | 77.76 MB | 31 Aug 2008 - 23:49 |
| Unknown robot (identified by hit on 'robots.txt') | 0+153 | 13.15 KB | 31 Aug 2008 - 23:36 |
| Harvest | 405 | 18.94 MB | 31 Aug 2008 - 23:33 |
| BaiDuSpider | 136+33 | 480.50 KB | 31 Aug 2008 - 23:04 |
| Googlebot | 1716+35 | 1.11 GB | 31 Aug 2008 - 23:03 |
| Voila | 98+34 | 59.83 MB | 31 Aug 2008 - 22:12 |
| Speedy Spider | 17+14 | 82.75 KB | 31 Aug 2008 - 21:33 |
| Nutch | 8+8 | 443.59 KB | 31 Aug 2008 - 21:18 |
| Ask | 176+32 | 9.95 MB | 31 Aug 2008 - 19:58 |
| Robozilla | 1 | 3.82 KB | 31 Aug 2008 - 19:08 |
| Unknown robot (identified by 'crawl') | 4346+594 | 387.13 MB | 31 Aug 2008 - 17:23 |
| Yandex bot | 513+23 | 195.86 MB | 31 Aug 2008 - 16:32 |
| Unknown robot (identified by empty user agent string) | 111+23 | 3.81 MB | 31 Aug 2008 - 12:15 |
| Unknown robot (identified by 'bot*') | 342+51 | 22.41 MB | 31 Aug 2008 - 11:13 |
| MSNBot-media | 270+54 | 62.10 MB | 30 Aug 2008 - 23:46 |
| Jakarta commons-httpclient | 47+1 | 108.02 KB | 30 Aug 2008 - 21:47 |
| Gaisbot | 1+1 | 3.91 KB | 30 Aug 2008 - 17:33 |
| Unknown robot (identified by 'spider') | 22+15 | 258.29 KB | 30 Aug 2008 - 14:23 |
| BSpider | 12+5 | 440 Bytes | 30 Aug 2008 - 12:23 |
| MSIECrawler | 6 | 24.73 KB | 29 Aug 2008 - 18:34 |
| Java (Often spam bot) | 238 | 879.13 KB | 29 Aug 2008 - 08:23 |
| twiceler | 0+11 | 968 Bytes | 29 Aug 2008 - 07:43 |
| Ocelli | 443+1 | 143.64 MB | 28 Aug 2008 - 17:50 |
| Unknown robot (identified by 'robot') | 499+19 | 1.77 MB | 28 Aug 2008 - 08:04 |
| YahooSeeker Yahoo! Blog crawler | 0+10 | 880 Bytes | 28 Aug 2008 - 05:53 |
| BBot | 6 | 44.16 KB | 26 Aug 2008 - 20:38 |
| Combine System | 4+1 | 14.55 KB | 26 Aug 2008 - 02:03 |
| GigaBot | 2+3 | 7.90 KB | 25 Aug 2008 - 03:05 |
| NG 2.x (Exalead) | 2+1 | 7.22 KB | 23 Aug 2008 - 02:49 |
| DoCoMo | 2+1 | 7.22 KB | 22 Aug 2008 - 16:50 |
| Perl tool | 3 | 16.70 KB | 22 Aug 2008 - 15:42 |
| Python-urllib | 1 | 3.82 KB | 22 Aug 2008 - 01:34 |
| Sogou Spider | 3 | 0 | 21 Aug 2008 - 09:50 |
| MJ12bot | 88+2 | 54.27 MB | 21 Aug 2008 - 05:21 |
| Dumbot | 2+1 | 9.23 KB | 20 Aug 2008 - 16:41 |
| WGet tools | 1 | 240.86 KB | 20 Aug 2008 - 03:32 |
| EasyDL | 3 | 18.12 KB | 18 Aug 2008 - 08:48 |
| CFNetwork | 1 | 723.98 KB | 13 Aug 2008 - 18:55 |
| LinkChecker | 33+1 | 276.45 KB | 11 Aug 2008 - 02:56 |
| boitho.com-dc | 2+3 | 8.07 KB | 11 Aug 2008 - 01:25 |
| Unknown robot (identified by '*bot') | 1+1 | 3.91 KB | 10 Aug 2008 - 06:45 |
| Exabot | 6+2 | 24.90 KB | 09 Aug 2008 - 10:35 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 07 Aug 2008 - 13:55 |
| Unknown robot (identified by 'discovery') | 9 | 16.02 KB | 07 Aug 2008 - 11:40 |
| Holmes | 0+2 | 176 Bytes | 05 Aug 2008 - 06:12 |
| psbot | 2+2 | 9.92 KB | 05 Aug 2008 - 04:56 |
| arks | 0+1 | 88 Bytes | 02 Aug 2008 - 23:56 |
| Heritrix | 1+1 | 3.91 KB | 02 Aug 2008 - 19:17 |
| Turn It In | 94+2 | 23.72 MB | 01 Aug 2008 - 17:53 |
| NutchCVS | 1+1 | 3.91 KB | 01 Aug 2008 - 11:55 |