| 58 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 2410+652 | 229.46 MB | 30 Sep 2005 - 23:45 |
| MSNBot | 1214+125 | 448.02 MB | 30 Sep 2005 - 23:29 |
| Googlebot | 2215+89 | 1.09 GB | 30 Sep 2005 - 23:06 |
| Unknown robot (identified by 'crawl') | 5582+303 | 49.15 MB | 30 Sep 2005 - 22:21 |
| Alexa (IA Archiver) | 2+6 | 19.23 KB | 30 Sep 2005 - 20:43 |
| Grub.org | 49 | 530.70 KB | 30 Sep 2005 - 20:08 |
| Unknown robot (identified by 'bot*') | 232+44 | 19.10 MB | 30 Sep 2005 - 18:51 |
| Ask | 80+17 | 542.06 KB | 30 Sep 2005 - 15:38 |
| Harvest | 77 | 112.20 KB | 30 Sep 2005 - 15:30 |
| aipbot | 105+4 | 847.96 KB | 30 Sep 2005 - 11:56 |
| Java (Often spam bot) | 442+2 | 1.55 MB | 30 Sep 2005 - 10:41 |
| LinkWalker | 63+21 | 113.51 KB | 30 Sep 2005 - 02:03 |
| Perl tool | 25 | 542.34 KB | 29 Sep 2005 - 20:16 |
| Jakarta commons-httpclient | 26 | 7.76 MB | 29 Sep 2005 - 12:25 |
| Unknown robot (identified by empty user agent string) | 25+27 | 4.36 MB | 29 Sep 2005 - 09:29 |
| MJ12bot | 13+4 | 74.10 KB | 29 Sep 2005 - 07:57 |
| Pompos | 0+1 | 88 Bytes | 29 Sep 2005 - 05:16 |
| BecomeBot | 213+33 | 1.40 MB | 29 Sep 2005 - 05:16 |
| Findlinks | 1+2 | 3.99 KB | 29 Sep 2005 - 03:07 |
| Unknown robot (identified by 'spider') | 6+6 | 23.44 KB | 28 Sep 2005 - 17:44 |
| InternetArchive | 8+3 | 71.93 KB | 28 Sep 2005 - 14:59 |
| WGet tools | 8 | 1.22 MB | 28 Sep 2005 - 13:16 |
| IBM Almaden Research Center WebFountain™ | 10+12 | 37.01 KB | 28 Sep 2005 - 10:28 |
| sohu-search | 5+5 | 19.54 KB | 27 Sep 2005 - 08:18 |
| Walhello appie | 0+3 | 264 Bytes | 26 Sep 2005 - 23:46 |
| Fast-Webcrawler | 1 | 3.82 KB | 26 Sep 2005 - 21:33 |
| twiceler | 0+2 | 176 Bytes | 26 Sep 2005 - 15:19 |
| Unknown robot (identified by 'robot') | 55+3 | 455.57 KB | 26 Sep 2005 - 08:48 |
| Unknown robot (identified by hit on 'robots.txt') | 0+9 | 704 Bytes | 26 Sep 2005 - 00:07 |
| Metaspinner | 1+1 | 3.91 KB | 25 Sep 2005 - 12:46 |
| Turn It In | 48+1 | 142.93 KB | 24 Sep 2005 - 22:45 |
| DoCoMo | 0+1 | 88 Bytes | 24 Sep 2005 - 15:25 |
| Python-urllib | 110+1 | 911.97 KB | 23 Sep 2005 - 18:57 |
| updated | 3+3 | 11.72 KB | 23 Sep 2005 - 01:22 |
| NutchCVS | 41+17 | 284.99 KB | 22 Sep 2005 - 05:29 |
| nicebot | 9 | 247.32 KB | 21 Sep 2005 - 13:18 |
| NG 2.x (Exalead) | 12+1 | 52.47 KB | 21 Sep 2005 - 12:20 |
| wume crawler | 2+1 | 11.08 KB | 21 Sep 2005 - 09:11 |
| Nutch | 178+8 | 1.43 MB | 18 Sep 2005 - 23:28 |
| Voila | 10+12 | 48.50 KB | 17 Sep 2005 - 21:43 |
| psbot | 4+4 | 8.99 KB | 14 Sep 2005 - 13:44 |
| MSIECrawler | 0+1 | 88 Bytes | 14 Sep 2005 - 11:01 |
| Digger | 1+1 | 3.91 KB | 14 Sep 2005 - 06:45 |
| larbin | 1 | 443 Bytes | 13 Sep 2005 - 15:04 |
| SBIder | 1+1 | 3.91 KB | 13 Sep 2005 - 05:49 |
| Cfetch | 3+1 | 7.22 KB | 12 Sep 2005 - 11:50 |
| Google AdSense | 1 | 7.82 KB | 12 Sep 2005 - 01:28 |
| BaiDuSpider | 1+1 | 3.91 KB | 11 Sep 2005 - 16:14 |
| UdmSearch | 2 | 4.67 KB | 11 Sep 2005 - 15:42 |
| IlTrovatore-Setaccio | 1+1 | 3.91 KB | 11 Sep 2005 - 00:48 |
| ActiveBookmark | 1 | 3.82 KB | 10 Sep 2005 - 19:00 |
| Girafabot | 5+1 | 20.99 KB | 09 Sep 2005 - 01:05 |
| GigaBot | 0+1 | 88 Bytes | 08 Sep 2005 - 11:17 |
| ConveraCrawler | 168+2 | 99.91 MB | 07 Sep 2005 - 04:35 |
| Heritrix | 456+3 | 249.96 MB | 06 Sep 2005 - 09:24 |
| Others | 0 | 31 Bytes | |