| 40 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 439+272 | 4.54 MB | 31 Jan 2006 - 20:58 |
| Harvest | 509 | 14.68 MB | 31 Jan 2006 - 23:51 |
| Java (Often spam bot) | 453+2 | 1.73 MB | 28 Jan 2006 - 15:20 |
| MSNBot | 318+127 | 4.76 MB | 31 Jan 2006 - 23:53 |
| Googlebot | 362+52 | 4.23 MB | 31 Jan 2006 - 21:28 |
| Ask | 128+18 | 1021.74 KB | 31 Jan 2006 - 23:22 |
| Python-urllib | 94 | 812.85 KB | 30 Jan 2006 - 14:42 |
| Yahoo Slurp | 43+40 | 88.98 KB | 31 Jan 2006 - 19:17 |
| Unknown robot (identified by 'bot*') | 61+11 | 822.78 KB | 30 Jan 2006 - 23:21 |
| Unknown robot (identified by 'robot') | 56+1 | 1.54 MB | 28 Jan 2006 - 12:28 |
| LinkChecker | 50+1 | 390.44 KB | 02 Jan 2006 - 20:44 |
| Unknown robot (identified by empty user agent string) | 34+11 | 459.48 KB | 29 Jan 2006 - 21:32 |
| psbot | 27+4 | 236.77 KB | 31 Jan 2006 - 23:08 |
| WGet tools | 29 | 204.55 KB | 09 Jan 2006 - 06:51 |
| Findlinks | 15+13 | 70.22 KB | 31 Jan 2006 - 19:32 |
| noxtrumbot | 22+1 | 127.47 KB | 26 Jan 2006 - 05:10 |
| Shim-Crawler | 8+14 | 66.83 KB | 25 Jan 2006 - 10:56 |
| BaiDuSpider | 12+4 | 792 Bytes | 30 Jan 2006 - 17:31 |
| zspider | 12 | 78.54 KB | 10 Jan 2006 - 18:56 |
| GigaBot | 6+5 | 13.64 KB | 30 Jan 2006 - 23:35 |
| Voyager | 3+3 | 8.49 KB | 30 Jan 2006 - 05:39 |
| Unknown robot (identified by hit on 'robots.txt') | 0+6 | 528 Bytes | 26 Jan 2006 - 18:18 |
| larbin | 5+1 | 14.93 KB | 15 Jan 2006 - 01:36 |
| miniRank | 3+2 | 12.44 KB | 04 Jan 2006 - 12:38 |
| Alexa (IA Archiver) | 2+3 | 13.36 KB | 27 Jan 2006 - 00:50 |
| Perl tool | 4+1 | 17.66 KB | 30 Jan 2006 - 19:13 |
| Jakarta commons-httpclient | 0+4 | 352 Bytes | 12 Jan 2006 - 16:00 |
| NutchCVS | 2+2 | 3.63 KB | 27 Jan 2006 - 14:10 |
| Voila | 2+2 | 6.22 KB | 27 Jan 2006 - 02:10 |
| HTTrack off-line browser | 3+1 | 3.11 KB | 09 Jan 2006 - 04:02 |
| ZyBorg | 0+2 | 176 Bytes | 31 Jan 2006 - 03:47 |
| Unknown robot (identified by 'discovery') | 2 | 440 Bytes | 04 Jan 2006 - 07:48 |
| nicebot | 2 | 5.86 KB | 10 Jan 2006 - 07:10 |
| lwp-trivial | 2 | 10.16 KB | 30 Jan 2006 - 10:18 |
| NG 2.x (Exalead) | 1+1 | 3.37 KB | 15 Jan 2006 - 00:22 |
| Cfetch | 1 | 0 | 15 Jan 2006 - 17:09 |
| Unknown robot (identified by '*bot') | 0+1 | 88 Bytes | 12 Jan 2006 - 19:14 |
| IRLbot | 0+1 | 88 Bytes | 26 Jan 2006 - 02:30 |
| MSIECrawler | 0+1 | 88 Bytes | 28 Jan 2006 - 00:24 |
| Others | 0 | 13 Bytes | |