| 49 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 3332+1000 | 311.65 MB | 28 Feb 2005 - 22:56 |
| Unknown robot (identified by 'crawl') | 2664+249 | 130.66 MB | 28 Feb 2005 - 23:41 |
| Googlebot | 1910+84 | 735.71 MB | 28 Feb 2005 - 23:52 |
| MSNBot | 1636+127 | 707.95 MB | 28 Feb 2005 - 23:46 |
| Harvest | 749 | 18.16 MB | 28 Feb 2005 - 23:02 |
| Ask | 528+36 | 3.22 MB | 28 Feb 2005 - 09:58 |
| Turn It In | 528+3 | 191.01 MB | 03 Feb 2005 - 01:51 |
| YahooSeeker Yahoo! Blog crawler | 289+28 | 1.30 MB | 27 Feb 2005 - 14:06 |
| Java (Often spam bot) | 181 | 1.52 MB | 28 Feb 2005 - 19:25 |
| Unknown robot (identified by 'bot*') | 96+35 | 402.58 KB | 28 Feb 2005 - 08:26 |
| LinkWalker | 60+20 | 108.11 KB | 28 Feb 2005 - 22:53 |
| sohu-search | 46+2 | 108.40 KB | 24 Feb 2005 - 20:37 |
| Unknown robot (identified by empty user agent string) | 39+1 | 25.30 MB | 28 Feb 2005 - 15:19 |
| NutchCVS | 22+10 | 123.43 KB | 27 Feb 2005 - 09:12 |
| BecomeBot | 21+10 | 147.54 KB | 24 Feb 2005 - 01:13 |
| IRLbot | 16+12 | 58.58 KB | 27 Feb 2005 - 11:59 |
| Voila | 9+17 | 52.82 KB | 28 Feb 2005 - 21:17 |
| Perl tool | 24 | 83.84 KB | 28 Feb 2005 - 07:17 |
| Unknown robot (identified by 'spider') | 10+6 | 52.70 KB | 27 Feb 2005 - 22:55 |
| webcrawl.net | 11+5 | 63.74 KB | 25 Feb 2005 - 22:31 |
| ConveraMultiMediaCrawler | 12+4 | 33.66 KB | 28 Feb 2005 - 21:24 |
| ZyBorg | 12+2 | 67.53 KB | 07 Feb 2005 - 21:41 |
| Unknown robot (identified by hit on 'robots.txt') | 0+12 | 968 Bytes | 27 Feb 2005 - 07:56 |
| Fast-Search-Engine (not fastsearch.com) | 10 | 57.91 KB | 14 Feb 2005 - 01:40 |
| Openfind data gatherer | 5+5 | 17.37 KB | 23 Feb 2005 - 20:32 |
| psbot | 5+4 | 22.67 KB | 27 Feb 2005 - 07:53 |
| IBM Almaden Research Center WebFountain™ | 4+4 | 15.63 KB | 24 Feb 2005 - 22:13 |
| Yahoo Vertical Crawler | 0+8 | 704 Bytes | 23 Feb 2005 - 12:55 |
| Fast-Webcrawler | 7+1 | 531 Bytes | 13 Feb 2005 - 20:26 |
| Findlinks | 5 | 22.28 KB | 28 Feb 2005 - 14:55 |
| Gaisbot | 2+2 | 9.31 KB | 21 Feb 2005 - 09:01 |
| Alexa (IA Archiver) | 2+2 | 7.81 KB | 06 Feb 2005 - 14:39 |
| Unknown robot (identified by 'robot') | 2+2 | 7.81 KB | 23 Feb 2005 - 18:30 |
| Unknown robot (identified by 'checker') | 4 | 0 | 04 Feb 2005 - 12:45 |
| MSIECrawler | 3+1 | 88 Bytes | 28 Feb 2005 - 14:16 |
| Jakarta commons-httpclient | 3 | 22.11 KB | 27 Feb 2005 - 01:15 |
| Grub.org | 3 | 22.89 KB | 27 Feb 2005 - 04:40 |
| GigaBot | 0+3 | 264 Bytes | 18 Feb 2005 - 22:30 |
| Speedy Spider | 2+1 | 3.91 KB | 18 Feb 2005 - 00:19 |
| UdmSearch | 1+1 | 0 | 24 Feb 2005 - 19:01 |
| GoForIt.com | 1+1 | 3.91 KB | 24 Feb 2005 - 02:51 |
| Holmes | 1 | 0 | 19 Feb 2005 - 14:07 |
| BaiDuSpider | 1 | 3.82 KB | 09 Feb 2005 - 11:22 |
| Yahoo-MMCrawler | 0+1 | 88 Bytes | 01 Feb 2005 - 15:24 |
| ActiveBookmark | 1 | 3.82 KB | 04 Feb 2005 - 15:33 |
| Python-urllib | 1 | 8.30 KB | 05 Feb 2005 - 20:39 |
| JoBo Java Web Robot | 0+1 | 88 Bytes | 24 Feb 2005 - 10:02 |
| Netcraft | 1 | 0 | 13 Feb 2005 - 01:16 |
| Others | 0 | 5 Bytes | |