| 62 different robots | Hits | Bandwidth | Last visit |
|---|
| psbot | 112+15 | 988.50 KB | 31 Jul 2005 - 23:59 |
| MSNBot | 1284+186 | 756.13 MB | 31 Jul 2005 - 23:57 |
| Yahoo Slurp | 2652+753 | 293.61 MB | 31 Jul 2005 - 23:03 |
| Googlebot | 1078+89 | 500.25 MB | 31 Jul 2005 - 22:00 |
| Unknown robot (identified by 'crawl') | 412+78 | 2.01 MB | 31 Jul 2005 - 19:25 |
| Dumbot | 16+4 | 192.06 KB | 31 Jul 2005 - 19:23 |
| Ask | 55+51 | 250.35 KB | 31 Jul 2005 - 19:10 |
| Vagabondo | 1+1 | 3.91 KB | 31 Jul 2005 - 18:02 |
| Harvest | 186 | 699.77 KB | 31 Jul 2005 - 15:30 |
| larbin | 32+5 | 189.83 KB | 31 Jul 2005 - 11:09 |
| Voila | 13+19 | 55.77 KB | 31 Jul 2005 - 07:59 |
| Walhello appie | 0+1 | 88 Bytes | 31 Jul 2005 - 07:37 |
| Findlinks | 19+1 | 111.32 KB | 31 Jul 2005 - 05:21 |
| Unknown robot (identified by 'robot') | 6+2 | 23.10 KB | 31 Jul 2005 - 04:15 |
| MJ12bot | 1+1 | 3.91 KB | 31 Jul 2005 - 03:09 |
| Unknown robot (identified by hit on 'robots.txt') | 0+13 | 1.03 KB | 31 Jul 2005 - 02:59 |
| Alexa (IA Archiver) | 23+21 | 185.39 KB | 31 Jul 2005 - 02:06 |
| Unknown robot (identified by 'bot*') | 226+55 | 1.81 MB | 31 Jul 2005 - 01:39 |
| BecomeBot | 197+42 | 1.30 MB | 30 Jul 2005 - 18:40 |
| NutchCVS | 25+18 | 116.04 KB | 30 Jul 2005 - 14:51 |
| WGet tools | 17+1 | 1.08 MB | 30 Jul 2005 - 10:22 |
| Grub.org | 87+1 | 937.61 KB | 30 Jul 2005 - 07:42 |
| Fish search | 340 | 60.64 MB | 30 Jul 2005 - 04:14 |
| Asterias | 3+3 | 11.72 KB | 30 Jul 2005 - 02:48 |
| Unknown robot (identified by empty user agent string) | 22+43 | 1.87 MB | 29 Jul 2005 - 22:25 |
| IBM Almaden Research Center WebFountain™ | 7+8 | 24.09 KB | 29 Jul 2005 - 17:29 |
| ZyBorg | 93+7 | 810.70 KB | 29 Jul 2005 - 12:48 |
| LinkWalker | 21+7 | 37.84 KB | 29 Jul 2005 - 08:48 |
| Cfetch | 6+1 | 18.71 KB | 29 Jul 2005 - 07:29 |
| EasyDL | 1 | 3.82 KB | 28 Jul 2005 - 16:46 |
| Java (Often spam bot) | 671 | 2.58 MB | 28 Jul 2005 - 14:59 |
| sohu-search | 5+4 | 19.45 KB | 28 Jul 2005 - 12:04 |
| Unknown robot (identified by 'spider') | 5+2 | 94.39 KB | 27 Jul 2005 - 19:56 |
| Unknown robot (identified by '*bot') | 1 | 3.82 KB | 27 Jul 2005 - 19:26 |
| Google AdSense | 2 | 14.89 KB | 27 Jul 2005 - 19:09 |
| aipbot | 4+5 | 15.71 KB | 26 Jul 2005 - 03:58 |
| Nutch | 363+3 | 236.90 MB | 23 Jul 2005 - 18:11 |
| Netcraft | 1 | 0 | 23 Jul 2005 - 09:25 |
| updated | 15+15 | 58.61 KB | 22 Jul 2005 - 16:32 |
| IRLbot | 0+2 | 176 Bytes | 21 Jul 2005 - 22:04 |
| HTTrack off-line browser | 59+2 | 426.04 KB | 21 Jul 2005 - 07:59 |
| Miva | 35+1 | 285.61 KB | 20 Jul 2005 - 19:13 |
| ActiveBookmark | 2 | 7.64 KB | 20 Jul 2005 - 16:54 |
| UCSD Crawl | 1 | 584.13 KB | 20 Jul 2005 - 09:25 |
| BaiDuSpider | 2 | 7.64 KB | 19 Jul 2005 - 16:43 |
| GigaBot | 0+1 | 88 Bytes | 18 Jul 2005 - 19:54 |
| Turn It In | 10+2 | 187.28 KB | 17 Jul 2005 - 22:31 |
| The web archive | 47+1 | 11.57 MB | 16 Jul 2005 - 13:54 |
| MSIECrawler | 1 | 0 | 16 Jul 2005 - 00:25 |
| Custo | 5 | 20.91 KB | 14 Jul 2005 - 14:34 |
| Gaisbot | 2+2 | 9.31 KB | 13 Jul 2005 - 21:29 |
| YahooSeeker Yahoo! Blog crawler | 977+33 | 366.26 MB | 13 Jul 2005 - 08:16 |
| boitho.com-dc | 2+1 | 6.42 KB | 12 Jul 2005 - 08:55 |
| INFOMINE VLCrawler | 2+2 | 7.81 KB | 10 Jul 2005 - 19:08 |
| nicebot | 2 | 210.58 KB | 10 Jul 2005 - 01:32 |
| noxtrumbot | 351+2 | 176.67 MB | 09 Jul 2005 - 15:51 |
| Openfind data gatherer | 2+2 | 4.26 KB | 06 Jul 2005 - 05:56 |
| NG 2.x (Exalead) | 10+1 | 26.25 KB | 02 Jul 2005 - 12:04 |
| ASPseek | 7 | 24.98 KB | 02 Jul 2005 - 09:13 |
| GoForIt.com | 1+1 | 3.91 KB | 01 Jul 2005 - 02:08 |
| Others | 0 | 6 Bytes | |