| 62 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 3382+649 | 210.72 MB | 31 Jan 2006 - 23:40 |
| Unknown robot (identified by 'crawl') | 2549+518 | 28.22 MB | 31 Jan 2006 - 23:48 |
| Googlebot | 1997+91 | 860.63 MB | 31 Jan 2006 - 23:47 |
| Java (Often spam bot) | 1375 | 5.09 MB | 29 Jan 2006 - 08:43 |
| MSNBot | 1169+172 | 651.31 MB | 31 Jan 2006 - 22:53 |
| Ask | 727+46 | 5.08 MB | 31 Jan 2006 - 23:58 |
| Unknown robot (identified by 'robot') | 399+1 | 235.60 MB | 31 Jan 2006 - 21:16 |
| Nutch | 328+15 | 2.65 MB | 26 Jan 2006 - 21:40 |
| Python-urllib | 333 | 2.77 MB | 30 Jan 2006 - 13:04 |
| WGet tools | 276+1 | 54.15 MB | 31 Jan 2006 - 21:57 |
| LinkChecker | 169+1 | 1.31 MB | 02 Jan 2006 - 22:17 |
| Unknown robot (identified by 'bot*') | 150+12 | 24.37 MB | 30 Jan 2006 - 21:28 |
| BecomeBot | 135+19 | 1.10 MB | 29 Jan 2006 - 08:50 |
| aipbot | 140+1 | 1.19 MB | 19 Jan 2006 - 23:49 |
| Unknown robot (identified by empty user agent string) | 120+17 | 1.30 MB | 26 Jan 2006 - 07:27 |
| Harvest | 109 | 440.64 KB | 31 Jan 2006 - 16:15 |
| ConveraCrawler | 82+2 | 452.14 KB | 27 Jan 2006 - 04:44 |
| Alexa (IA Archiver) | 49+5 | 342.62 KB | 30 Jan 2006 - 13:48 |
| LinkWalker | 36+12 | 64.86 KB | 30 Jan 2006 - 05:30 |
| NutchCVS | 20+17 | 79.94 KB | 31 Jan 2006 - 11:29 |
| Findlinks | 12+15 | 45.50 KB | 31 Jan 2006 - 20:59 |
| Turn It In | 23+1 | 90.55 KB | 09 Jan 2006 - 23:05 |
| Voila | 10+14 | 32.44 KB | 31 Jan 2006 - 03:31 |
| psbot | 19+4 | 197.99 KB | 30 Jan 2006 - 14:57 |
| Unknown robot (identified by 'spider') | 11+11 | 42.98 KB | 31 Jan 2006 - 17:52 |
| Exabot | 20+1 | 103.61 KB | 25 Jan 2006 - 03:05 |
| IBM Almaden Research Center WebFountain™ | 8+10 | 29.20 KB | 28 Jan 2006 - 15:01 |
| Unknown robot (identified by hit on 'robots.txt') | 0+17 | 1.29 KB | 31 Jan 2006 - 15:53 |
| UdmSearch | 13+1 | 32.74 KB | 23 Jan 2006 - 06:18 |
| Perl tool | 13+1 | 302.87 KB | 25 Jan 2006 - 07:20 |
| MJ12bot | 10+4 | 57.69 KB | 30 Jan 2006 - 20:58 |
| zspider | 10 | 34.93 KB | 10 Jan 2006 - 18:51 |
| BaiDuSpider | 6+2 | 23.10 KB | 25 Jan 2006 - 02:52 |
| Yahoo-MMCrawler | 7+1 | 88 Bytes | 18 Jan 2006 - 09:55 |
| HTTrack off-line browser | 7+1 | 754.49 KB | 31 Jan 2006 - 18:26 |
| Girafabot | 5+2 | 21.08 KB | 18 Jan 2006 - 15:00 |
| Voyager | 4+3 | 87.14 KB | 31 Jan 2006 - 17:51 |
| Openfind data gatherer | 3+4 | 11.34 KB | 30 Jan 2006 - 03:35 |
| NetSprint | 6 | 31.47 KB | 26 Jan 2006 - 14:56 |
| miniRank | 4+2 | 17.48 KB | 04 Jan 2006 - 12:54 |
| GigaBot | 3+3 | 32.42 KB | 21 Jan 2006 - 10:32 |
| Speedy Spider | 3+3 | 10.39 KB | 15 Jan 2006 - 18:20 |
| NG 2.x (Exalead) | 3+2 | 7.31 KB | 15 Jan 2006 - 06:09 |
| Unknown robot (identified by 'discovery') | 4 | 0 | 06 Jan 2006 - 08:37 |
| Jakarta commons-httpclient | 1+2 | 282.23 KB | 11 Jan 2006 - 02:56 |
| NimbleCrawler | 2+1 | 6.40 KB | 31 Jan 2006 - 14:00 |
| noxtrumbot | 1+1 | 3.40 KB | 19 Jan 2006 - 08:01 |
| Pompos | 1+1 | 88 Bytes | 01 Jan 2006 - 04:46 |
| ZyBorg | 0+2 | 176 Bytes | 30 Jan 2006 - 02:22 |
| plinki | 1+1 | 3.91 KB | 09 Jan 2006 - 23:57 |
| larbin | 1+1 | 10.17 KB | 15 Jan 2006 - 14:33 |
| IRLbot | 1+1 | 3.91 KB | 27 Jan 2006 - 23:24 |
| VORTEX | 2 | 6.53 KB | 05 Jan 2006 - 07:24 |
| Cfetch | 1 | 0 | 24 Jan 2006 - 08:30 |
| Unknown robot (identified by '*bot') | 1 | 3.82 KB | 25 Jan 2006 - 12:15 |
| Custo | 1 | 97.28 KB | 23 Jan 2006 - 08:32 |
| CFNetwork | 1 | 740.74 KB | 25 Jan 2006 - 22:51 |
| lwp-trivial | 1 | 8.57 KB | 20 Jan 2006 - 03:08 |
| MSIECrawler | 0+1 | 88 Bytes | 28 Jan 2006 - 00:28 |
| Sogou Spider | 1 | 5.32 KB | 14 Jan 2006 - 03:24 |
| Others | 0 | 54 Bytes | |