| 49 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 2018+589 | 269.30 MB | 31 May 2005 - 22:34 |
| Python-urllib | 2324 | 1.53 GB | 31 May 2005 - 14:58 |
| MSNBot | 1845+144 | 858.35 MB | 31 May 2005 - 23:58 |
| YahooSeeker Yahoo! Blog crawler | 1530+45 | 429.82 MB | 31 May 2005 - 10:31 |
| Unknown robot (identified by 'crawl') | 1106+338 | 12.77 MB | 31 May 2005 - 22:47 |
| Googlebot | 1205+86 | 692.85 MB | 31 May 2005 - 23:49 |
| Java (Often spam bot) | 651+3 | 2.60 MB | 31 May 2005 - 09:23 |
| ZyBorg | 378+9 | 3.72 MB | 31 May 2005 - 23:53 |
| Harvest | 384 | 6.15 MB | 31 May 2005 - 16:07 |
| Unknown robot (identified by 'bot*') | 360+11 | 183.83 MB | 29 May 2005 - 09:37 |
| BecomeBot | 307+58 | 2.17 MB | 31 May 2005 - 02:18 |
| IRLbot | 163+39 | 450.02 KB | 27 May 2005 - 20:26 |
| Turn It In | 191+2 | 46.84 MB | 26 May 2005 - 12:37 |
| WGet tools | 116+2 | 939.37 KB | 24 May 2005 - 05:22 |
| aipbot | 108+10 | 844.68 KB | 26 May 2005 - 22:25 |
| Ask | 76+36 | 59.03 MB | 31 May 2005 - 16:07 |
| LinkWalker | 66+22 | 118.92 KB | 31 May 2005 - 06:11 |
| Grub.org | 79 | 776.72 KB | 31 May 2005 - 16:00 |
| Speedy Spider | 44+22 | 105.63 KB | 29 May 2005 - 17:48 |
| Unknown robot (identified by empty user agent string) | 37+27 | 1.34 MB | 31 May 2005 - 07:03 |
| The web archive | 47+1 | 11.57 MB | 31 May 2005 - 22:06 |
| Perl tool | 37 | 432.62 KB | 31 May 2005 - 08:06 |
| Voila | 13+14 | 77.88 KB | 29 May 2005 - 01:17 |
| Alexa (IA Archiver) | 14+8 | 16.40 MB | 31 May 2005 - 20:30 |
| Unknown robot (identified by 'robot') | 12+4 | 68.86 KB | 26 May 2005 - 19:32 |
| NutchCVS | 6+6 | 23.44 KB | 31 May 2005 - 13:25 |
| Unknown robot (identified by 'spider') | 8+3 | 102.96 KB | 21 May 2005 - 13:25 |
| Unknown robot (identified by 'discovery') | 10 | 0 | 05 May 2005 - 10:07 |
| Yahoo-MMCrawler | 7+3 | 264 Bytes | 30 May 2005 - 03:23 |
| IBM Almaden Research Center WebFountain™ | 5+5 | 19.54 KB | 30 May 2005 - 19:57 |
| Unknown robot (identified by hit on 'robots.txt') | 0+9 | 704 Bytes | 22 May 2005 - 10:28 |
| BBot | 9 | 28.85 KB | 27 May 2005 - 07:22 |
| Yandex bot | 5 | 102.85 KB | 31 May 2005 - 04:46 |
| IlTrovatore-Setaccio | 3+1 | 7.64 KB | 06 May 2005 - 11:24 |
| GoForIt.com | 2+2 | 7.81 KB | 22 May 2005 - 21:49 |
| Findlinks | 4 | 17.17 KB | 19 May 2005 - 10:39 |
| Openfind data gatherer | 2+2 | 4.26 KB | 07 May 2005 - 01:51 |
| Custo | 3 | 1.94 MB | 23 May 2005 - 05:19 |
| Gaisbot | 2+1 | 9.23 KB | 04 May 2005 - 21:07 |
| GigaBot | 0+3 | 264 Bytes | 19 May 2005 - 20:00 |
| Jakarta commons-httpclient | 0+2 | 176 Bytes | 21 May 2005 - 10:26 |
| sohu-search | 1+1 | 3.91 KB | 27 May 2005 - 09:05 |
| UdmSearch | 1+1 | 0 | 28 May 2005 - 15:49 |
| psbot | 1+1 | 7.87 KB | 16 May 2005 - 00:00 |
| BaiDuSpider | 1+1 | 3.91 KB | 26 May 2005 - 16:31 |
| NG 2.x (Exalead) | 1+1 | 88 Bytes | 26 May 2005 - 10:48 |
| boitho.com-dc | 1 | 2.35 KB | 30 May 2005 - 01:49 |
| twiceler | 0+1 | 88 Bytes | 26 May 2005 - 15:33 |
| Others | 0 | 6 Bytes | |