| 52 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 5607+1381 | 837.55 MB | 31 Dec 2006 - 23:53 |
| Unknown robot (identified by 'crawl') | 3995+240 | 908.84 MB | 31 Dec 2006 - 23:40 |
| Unknown robot (identified by 'bot*') | 1961+18 | 75.14 MB | 30 Dec 2006 - 22:24 |
| MSNBot | 759+432 | 243.32 MB | 31 Dec 2006 - 22:42 |
| Googlebot | 727+32 | 372.15 MB | 31 Dec 2006 - 15:14 |
| MSNBot-media | 467+52 | 68.78 MB | 27 Dec 2006 - 12:19 |
| Perl tool | 355+13 | 1.88 MB | 26 Dec 2006 - 20:40 |
| ASpider (Associative Spider) | 313+2 | 1.52 MB | 08 Dec 2006 - 20:44 |
| noxtrumbot | 304+2 | 151.08 MB | 09 Dec 2006 - 15:04 |
| NutchCVS | 196+3 | 64.57 MB | 24 Dec 2006 - 23:46 |
| LinkChecker | 172+1 | 1.32 MB | 19 Dec 2006 - 10:33 |
| psbot | 137+11 | 1.19 MB | 07 Dec 2006 - 00:33 |
| Ask | 85+51 | 56.25 MB | 29 Dec 2006 - 16:37 |
| Voila | 53+66 | 148.56 KB | 28 Dec 2006 - 20:34 |
| Sogou Spider | 56+17 | 32.66 MB | 31 Dec 2006 - 18:55 |
| Java (Often spam bot) | 50 | 2.22 MB | 31 Dec 2006 - 04:51 |
| ichiro | 44+2 | 317.27 KB | 17 Dec 2006 - 11:42 |
| Harvest | 43 | 81.23 KB | 31 Dec 2006 - 15:30 |
| YahooSeeker Yahoo! Blog crawler | 31+4 | 333.11 KB | 27 Dec 2006 - 15:21 |
| Exabot | 23+10 | 116.24 KB | 30 Dec 2006 - 17:35 |
| Unknown robot (identified by empty user agent string) | 27+5 | 3.14 MB | 29 Dec 2006 - 08:52 |
| Findlinks | 21+9 | 113.91 KB | 31 Dec 2006 - 03:56 |
| Unknown robot (identified by hit on 'robots.txt') | 0+22 | 880 Bytes | 30 Dec 2006 - 19:34 |
| Fast-Webcrawler | 21+1 | 137.90 KB | 07 Dec 2006 - 14:00 |
| BaiDuSpider | 16+1 | 88 Bytes | 31 Dec 2006 - 17:00 |
| Nutch | 8+9 | 53.70 KB | 30 Dec 2006 - 11:20 |
| Alexa (IA Archiver) | 11+6 | 63.10 KB | 18 Dec 2006 - 14:08 |
| Unknown robot (identified by 'spider') | 9+7 | 55.08 KB | 27 Dec 2006 - 07:21 |
| Yahoo-MMCrawler | 9+3 | 17.82 KB | 22 Dec 2006 - 18:50 |
| Voyager | 9+3 | 33.07 KB | 20 Dec 2006 - 14:19 |
| nicebot | 10 | 53.27 KB | 23 Dec 2006 - 17:43 |
| GigaBot | 4+6 | 764.47 KB | 25 Dec 2006 - 12:21 |
| WGet tools | 5+2 | 34.43 KB | 31 Dec 2006 - 23:37 |
| Girafabot | 5+2 | 21.08 KB | 14 Dec 2006 - 09:56 |
| HTTrack off-line browser | 2+3 | 4.08 KB | 21 Dec 2006 - 10:40 |
| Unknown robot (identified by 'robot') | 3+2 | 8.66 KB | 29 Dec 2006 - 19:48 |
| ZyBorg | 2+2 | 7.81 KB | 31 Dec 2006 - 17:32 |
| ConveraCrawler | 2+2 | 176 Bytes | 23 Dec 2006 - 15:39 |
| BecomeBot | 2+1 | 13.69 KB | 23 Dec 2006 - 20:42 |
| larbin | 2+1 | 7.73 KB | 28 Dec 2006 - 11:28 |
| Holmes | 1+1 | 3.91 KB | 24 Dec 2006 - 01:32 |
| OutfoxBot/YodaoBot | 1+1 | 3.91 KB | 30 Dec 2006 - 06:55 |
| Gaisbot | 1+1 | 3.91 KB | 01 Dec 2006 - 07:00 |
| Shim-Crawler | 1+1 | 531 Bytes | 25 Dec 2006 - 04:48 |
| Openfind data gatherer | 2 | 8.97 KB | 12 Dec 2006 - 14:35 |
| Speedy Spider | 1+1 | 3.91 KB | 16 Dec 2006 - 05:24 |
| Jakarta commons-httpclient | 1 | 7.00 KB | 13 Dec 2006 - 10:29 |
| twiceler | 0+1 | 88 Bytes | 01 Dec 2006 - 17:26 |
| Python-urllib | 1 | 3.82 KB | 20 Dec 2006 - 04:50 |
| MSRBOT | 0+1 | 88 Bytes | 07 Dec 2006 - 15:08 |
| Others | 0 | 1 Bytes | |