| 34 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 507+391 | 4.22 MB | 31 Dec 2006 - 21:50 |
| Unknown robot (identified by 'crawl') | 528+141 | 6.54 MB | 31 Dec 2006 - 23:53 |
| MSNBot | 321+220 | 3.96 MB | 31 Dec 2006 - 16:41 |
| Harvest | 375 | 2.38 MB | 31 Dec 2006 - 19:30 |
| Googlebot | 130+25 | 1.64 MB | 31 Dec 2006 - 05:47 |
| Java (Often spam bot) | 134 | 530.02 KB | 11 Dec 2006 - 12:30 |
| Fast-Webcrawler | 127+1 | 1.54 MB | 13 Dec 2006 - 04:04 |
| MSNBot-media | 97+20 | 729.65 KB | 30 Dec 2006 - 09:30 |
| ichiro | 56+2 | 411.05 KB | 16 Dec 2006 - 11:55 |
| Unknown robot (identified by 'robot') | 25+32 | 160.78 KB | 29 Dec 2006 - 12:17 |
| Unknown robot (identified by 'bot*') | 45+10 | 380.58 KB | 31 Dec 2006 - 05:17 |
| LinkChecker | 49+1 | 390.44 KB | 19 Dec 2006 - 09:48 |
| Ask | 34+15 | 1.34 MB | 28 Dec 2006 - 21:23 |
| Perl tool | 34 | 130.82 KB | 06 Dec 2006 - 01:42 |
| Sogou Spider | 13+16 | 41.20 KB | 31 Dec 2006 - 08:23 |
| Findlinks | 18+8 | 204.12 KB | 31 Dec 2006 - 07:16 |
| Alexa (IA Archiver) | 16+9 | 51.08 KB | 21 Dec 2006 - 02:50 |
| Voyager | 21+3 | 184.50 KB | 21 Dec 2006 - 03:14 |
| psbot | 19+4 | 176.09 KB | 02 Dec 2006 - 05:22 |
| Unknown robot (identified by empty user agent string) | 12+7 | 313.07 KB | 31 Dec 2006 - 17:48 |
| Voila | 8+8 | 9.76 KB | 26 Dec 2006 - 15:12 |
| Nutch | 5+5 | 33.98 KB | 29 Dec 2006 - 17:09 |
| IBM Almaden Research Center WebFountain™ | 4+2 | 12.31 KB | 26 Dec 2006 - 16:26 |
| noxtrumbot | 3+2 | 6.65 KB | 14 Dec 2006 - 11:26 |
| BecomeBot | 3+1 | 13.10 KB | 28 Dec 2006 - 22:03 |
| WGet tools | 3 | 440 Bytes | 07 Dec 2006 - 16:26 |
| HTTrack off-line browser | 2+1 | 3.37 KB | 21 Dec 2006 - 10:37 |
| larbin | 2+1 | 6.13 KB | 28 Dec 2006 - 09:48 |
| YahooSeeker Yahoo! Blog crawler | 0+2 | 176 Bytes | 10 Dec 2006 - 05:20 |
| ZyBorg | 1+1 | 3.11 KB | 29 Dec 2006 - 23:26 |
| Shim-Crawler | 1+1 | 528 Bytes | 25 Dec 2006 - 06:07 |
| ConveraCrawler | 1+1 | 88 Bytes | 15 Dec 2006 - 06:58 |
| twiceler | 0+1 | 88 Bytes | 01 Dec 2006 - 21:12 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1 | 88 Bytes | 27 Dec 2006 - 12:53 |