| 52 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 2649+824 | 248.36 MB | 31 Dec 2007 - 23:48 |
| Yahoo Slurp | 3108+137 | 399.91 MB | 31 Dec 2007 - 23:56 |
| MSNBot | 1788+882 | 298.68 MB | 31 Dec 2007 - 23:18 |
| Googlebot | 1815+34 | 1.06 GB | 31 Dec 2007 - 18:40 |
| MJ12bot | 700+1 | 121.33 MB | 31 Dec 2007 - 09:31 |
| Ask | 411+80 | 2.75 MB | 31 Dec 2007 - 22:16 |
| Ocelli | 375+1 | 116.56 MB | 27 Dec 2007 - 07:18 |
| psbot | 336+12 | 1.81 MB | 21 Dec 2007 - 04:43 |
| Nutch | 239+100 | 1.34 MB | 31 Dec 2007 - 23:47 |
| Unknown robot (identified by 'bot*') | 258+72 | 311.75 MB | 31 Dec 2007 - 21:05 |
| Yandex bot | 305+16 | 234.81 MB | 31 Dec 2007 - 11:24 |
| MSNBot-media | 233+42 | 53.25 MB | 31 Dec 2007 - 10:09 |
| Voila | 109+132 | 563.18 KB | 31 Dec 2007 - 23:13 |
| Unknown robot (identified by empty user agent string) | 166+26 | 2.78 MB | 31 Dec 2007 - 13:22 |
| Unknown robot (identified by hit on 'robots.txt') | 0+169 | 3.52 KB | 31 Dec 2007 - 21:32 |
| Python-urllib | 125 | 4.75 MB | 30 Dec 2007 - 03:02 |
| BaiDuSpider | 82+36 | 266.76 KB | 31 Dec 2007 - 15:04 |
| Harvest | 117 | 808.45 KB | 31 Dec 2007 - 15:30 |
| Java (Often spam bot) | 50 | 697.42 KB | 22 Dec 2007 - 08:34 |
| BecomeBot | 16+18 | 88.06 KB | 24 Dec 2007 - 14:10 |
| Turn It In | 30+1 | 6.20 MB | 12 Dec 2007 - 19:42 |
| Speedy Spider | 16+14 | 126.95 KB | 31 Dec 2007 - 15:42 |
| Voyager | 13+8 | 75.26 KB | 16 Dec 2007 - 16:01 |
| Unknown robot (identified by 'spider') | 13+7 | 70.56 KB | 26 Dec 2007 - 20:21 |
| Unknown robot (identified by 'robot') | 11+5 | 46.29 KB | 28 Dec 2007 - 12:43 |
| Exabot | 9+4 | 47.05 KB | 31 Dec 2007 - 17:29 |
| OutfoxBot/YodaoBot | 6+4 | 10.99 KB | 25 Dec 2007 - 12:35 |
| WGet tools | 9 | 12.25 KB | 28 Dec 2007 - 15:10 |
| twiceler | 0+9 | 792 Bytes | 28 Dec 2007 - 02:18 |
| QihooBot | 9 | 34.95 KB | 30 Dec 2007 - 08:19 |
| Yahoo-MMCrawler | 7+1 | 88 Bytes | 18 Dec 2007 - 22:44 |
| MSIECrawler | 6+1 | 24.81 KB | 27 Dec 2007 - 04:35 |
| Grub.org | 3+3 | 11.72 KB | 29 Dec 2007 - 09:45 |
| boitho.com-dc | 3+2 | 11.66 KB | 30 Dec 2007 - 17:34 |
| HTTrack off-line browser | 5 | 3.31 KB | 30 Dec 2007 - 12:22 |
| Sogou Spider | 4+1 | 11.55 KB | 26 Dec 2007 - 15:22 |
| Alexa (IA Archiver) | 2+2 | 12.59 KB | 30 Dec 2007 - 10:46 |
| Perl tool | 4 | 19.73 KB | 27 Dec 2007 - 23:47 |
| MSRBOT | 2+2 | 1.29 KB | 02 Dec 2007 - 08:10 |
| larbin | 2+2 | 7.81 KB | 10 Dec 2007 - 04:45 |
| Holmes | 0+3 | 264 Bytes | 27 Dec 2007 - 05:13 |
| YahooSeeker Yahoo! Blog crawler | 0+3 | 264 Bytes | 28 Dec 2007 - 03:07 |
| noxtrumbot | 0+2 | 176 Bytes | 19 Dec 2007 - 22:31 |
| NutchCVS | 1+1 | 3.91 KB | 15 Dec 2007 - 16:12 |
| yacy | 1+1 | 3.91 KB | 06 Dec 2007 - 06:46 |
| lwp-trivial | 2 | 11.76 KB | 30 Dec 2007 - 13:21 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 31 Dec 2007 - 10:46 |
| Unknown robot (identified by '*bot') | 1 | 7.28 KB | 10 Dec 2007 - 14:56 |
| SuperBot | 1 | 3.31 KB | 16 Dec 2007 - 15:12 |
| Robozilla | 1 | 3.82 KB | 09 Dec 2007 - 02:18 |
| Unknown robot (identified by 'checker') | 1 | 3.82 KB | 28 Dec 2007 - 07:01 |
| Fish search | 1 | 2.92 KB | 28 Dec 2007 - 19:29 |