| 60 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 2347+568 | 186.12 MB | 31 Dec 2005 - 23:56 |
| Googlebot | 2266+94 | 701.44 MB | 31 Dec 2005 - 23:46 |
| Unknown robot (identified by 'crawl') | 1684+325 | 19.33 MB | 31 Dec 2005 - 23:39 |
| MSNBot | 1226+175 | 691.27 MB | 31 Dec 2005 - 23:29 |
| Perl tool | 11 | 37.85 KB | 31 Dec 2005 - 23:15 |
| NutchCVS | 39+22 | 214.22 KB | 31 Dec 2005 - 21:12 |
| Nutch | 210+12 | 1.69 MB | 31 Dec 2005 - 20:41 |
| Pompos | 0+2 | 176 Bytes | 31 Dec 2005 - 19:36 |
| Harvest | 190 | 738.40 KB | 31 Dec 2005 - 16:15 |
| Findlinks | 13+8 | 80.92 KB | 31 Dec 2005 - 15:05 |
| VORTEX | 1+2 | 8.46 KB | 31 Dec 2005 - 14:00 |
| Java (Often spam bot) | 1919 | 391.09 MB | 31 Dec 2005 - 12:04 |
| Geniebot | 3+2 | 18.80 KB | 31 Dec 2005 - 09:35 |
| Unknown robot (identified by 'bot*') | 555+8 | 207.44 MB | 31 Dec 2005 - 01:30 |
| MSIECrawler | 5 | 317.55 KB | 31 Dec 2005 - 00:13 |
| Unknown robot (identified by 'robot') | 28+2 | 225.96 KB | 30 Dec 2005 - 19:14 |
| BecomeBot | 189+31 | 1.29 MB | 30 Dec 2005 - 18:12 |
| sohu agent | 5 | 15.33 KB | 30 Dec 2005 - 13:15 |
| Unknown robot (identified by empty user agent string) | 27+13 | 2.86 MB | 30 Dec 2005 - 10:58 |
| GigaBot | 2+2 | 7.81 KB | 30 Dec 2005 - 10:56 |
| nicebot | 4 | 98.98 KB | 30 Dec 2005 - 07:44 |
| Unknown robot (identified by 'spider') | 11+11 | 42.98 KB | 30 Dec 2005 - 03:08 |
| IBM Almaden Research Center WebFountain™ | 9+11 | 33.10 KB | 29 Dec 2005 - 22:49 |
| Ask | 43+20 | 92.09 MB | 29 Dec 2005 - 22:41 |
| Unknown robot (identified by hit on 'robots.txt') | 0+11 | 880 Bytes | 29 Dec 2005 - 17:45 |
| HTTrack off-line browser | 3 | 414.78 KB | 29 Dec 2005 - 12:29 |
| ConveraCrawler | 5+2 | 11.64 KB | 29 Dec 2005 - 12:09 |
| Voila | 13+15 | 73.79 KB | 28 Dec 2005 - 20:54 |
| Alexa (IA Archiver) | 18+5 | 5.07 MB | 28 Dec 2005 - 13:13 |
| larbin | 18+3 | 96.13 KB | 28 Dec 2005 - 09:28 |
| BaiDuSpider | 5+2 | 18.28 KB | 28 Dec 2005 - 05:08 |
| Voyager | 11+9 | 108.84 KB | 28 Dec 2005 - 01:28 |
| G2Crawler | 23+4 | 206.96 KB | 26 Dec 2005 - 21:25 |
| HTMLParser | 2 | 7.64 KB | 26 Dec 2005 - 11:35 |
| MJ12bot | 7+1 | 45.97 KB | 25 Dec 2005 - 08:41 |
| Girafabot | 5+1 | 20.99 KB | 24 Dec 2005 - 00:25 |
| Accoona-AI-Agent | 1+1 | 3.19 KB | 22 Dec 2005 - 13:27 |
| NG 2.x (Exalead) | 3+2 | 176 Bytes | 21 Dec 2005 - 11:59 |
| psbot | 0+1 | 88 Bytes | 21 Dec 2005 - 06:55 |
| Jakarta commons-httpclient | 26+116 | 209.04 KB | 20 Dec 2005 - 13:01 |
| Speedy Spider | 1+1 | 3.91 KB | 20 Dec 2005 - 03:48 |
| LinkWalker | 36+12 | 64.86 KB | 19 Dec 2005 - 06:30 |
| twiceler | 0+2 | 176 Bytes | 18 Dec 2005 - 07:44 |
| lwp-trivial | 2 | 15.12 KB | 18 Dec 2005 - 06:37 |
| Gaisbot | 1+1 | 3.91 KB | 17 Dec 2005 - 20:47 |
| ichiro | 5+2 | 19.28 KB | 17 Dec 2005 - 17:01 |
| xirq | 2+2 | 7.81 KB | 17 Dec 2005 - 04:25 |
| Turn It In | 3+2 | 14.63 KB | 17 Dec 2005 - 01:55 |
| LinkChecker | 1 | 3.82 KB | 16 Dec 2005 - 12:46 |
| Walhello appie | 0+2 | 176 Bytes | 15 Dec 2005 - 16:07 |
| Python-urllib | 552 | 226.18 MB | 14 Dec 2005 - 11:46 |
| Yahoo-MMCrawler | 7+1 | 88 Bytes | 12 Dec 2005 - 19:31 |
| SynooBot | 1+1 | 3.91 KB | 12 Dec 2005 - 13:11 |
| sohu-search | 1+1 | 3.91 KB | 07 Dec 2005 - 10:17 |
| ZyBorg | 19+1 | 195.73 KB | 05 Dec 2005 - 14:18 |
| Custo | 4 | 15.07 KB | 04 Dec 2005 - 17:10 |
| SBIder | 1+1 | 3.91 KB | 03 Dec 2005 - 14:54 |
| Unknown robot (identified by 'discovery') | 4 | 0 | 03 Dec 2005 - 02:25 |
| WGet tools | 2 | 447.40 KB | 02 Dec 2005 - 05:16 |
| Others | 0 | 18 Bytes | |