| 48 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 4227+453 | 434.54 MB | 30 Nov 2008 - 23:58 |
| Unknown robot (identified by 'crawl') | 3838+578 | 188.02 MB | 30 Nov 2008 - 23:19 |
| Googlebot | 2198+40 | 1.31 GB | 30 Nov 2008 - 22:27 |
| MSNBot | 920+516 | 115.97 MB | 30 Nov 2008 - 21:35 |
| Ocelli | 442+1 | 137.36 MB | 02 Nov 2008 - 01:23 |
| Yandex bot | 389+22 | 3.14 MB | 30 Nov 2008 - 22:57 |
| Ask | 340+50 | 86.73 MB | 29 Nov 2008 - 21:28 |
| Harvest | 351 | 7.92 MB | 30 Nov 2008 - 15:30 |
| Voila | 172+57 | 119.23 MB | 30 Nov 2008 - 20:08 |
| Java (Often spam bot) | 219 | 872.89 KB | 27 Nov 2008 - 20:22 |
| BaiDuSpider | 173+34 | 652.54 KB | 30 Nov 2008 - 23:04 |
| Unknown robot (identified by hit on 'robots.txt') | 0+199 | 1.98 KB | 29 Nov 2008 - 07:29 |
| Unknown robot (identified by 'bot*') | 96+44 | 42.44 MB | 30 Nov 2008 - 11:39 |
| MSNBot-media | 88+49 | 7.36 MB | 30 Nov 2008 - 14:49 |
| Nutch | 84+32 | 2.48 MB | 29 Nov 2008 - 14:06 |
| Unknown robot (identified by 'spider') | 104+10 | 559.27 KB | 30 Nov 2008 - 15:00 |
| Unknown robot (identified by empty user agent string) | 71+34 | 14.05 MB | 30 Nov 2008 - 19:19 |
| Voyager | 79+10 | 32.96 MB | 30 Nov 2008 - 14:07 |
| Turn It In | 54+9 | 279.16 KB | 29 Nov 2008 - 00:22 |
| Exabot | 33+22 | 229.33 KB | 28 Nov 2008 - 07:34 |
| Speedy Spider | 25+19 | 774.39 KB | 26 Nov 2008 - 04:28 |
| ichiro | 32+1 | 94.34 KB | 08 Nov 2008 - 09:50 |
| Unknown robot (identified by 'robot') | 15+15 | 64.44 KB | 27 Nov 2008 - 03:49 |
| Alexa (IA Archiver) | 17+4 | 102.61 KB | 14 Nov 2008 - 03:16 |
| Jakarta commons-httpclient | 18 | 7.79 KB | 27 Nov 2008 - 02:37 |
| twiceler | 0+17 | 1.46 KB | 30 Nov 2008 - 11:24 |
| YahooSeeker Yahoo! Blog crawler | 5+11 | 23.05 KB | 30 Nov 2008 - 02:07 |
| yacy | 5+4 | 19.45 KB | 14 Nov 2008 - 07:34 |
| Yanga WorldSearch Bot | 4+4 | 15.63 KB | 11 Nov 2008 - 12:43 |
| Sogou Spider | 7 | 157.34 KB | 30 Nov 2008 - 05:25 |
| BBot | 6 | 44.16 KB | 01 Nov 2008 - 21:13 |
| BSpider | 1+4 | 352 Bytes | 25 Nov 2008 - 13:00 |
| GigaBot | 3+2 | 10.17 KB | 29 Nov 2008 - 19:43 |
| psbot | 2+2 | 8.74 KB | 12 Nov 2008 - 00:55 |
| WGet tools | 3+1 | 1.10 MB | 30 Nov 2008 - 01:23 |
| MSIECrawler | 0+4 | 176 Bytes | 20 Nov 2008 - 14:53 |
| The web archive (IA Archiver) | 0+3 | 264 Bytes | 25 Nov 2008 - 23:10 |
| Perl tool | 3 | 11.46 KB | 22 Nov 2008 - 07:13 |
| Unknown robot (identified by '*bot') | 1+1 | 9.46 KB | 11 Nov 2008 - 08:17 |
| boitho.com-dc | 2 | 13.61 KB | 09 Nov 2008 - 14:42 |
| Gaisbot | 1+1 | 5.41 KB | 02 Nov 2008 - 03:16 |
| Spiderman | 1+1 | 3.91 KB | 20 Nov 2008 - 14:33 |
| Heritrix | 1+1 | 3.91 KB | 12 Nov 2008 - 11:26 |
| MJ12bot | 1+1 | 5.96 KB | 03 Nov 2008 - 18:31 |
| UCSD Crawl | 1 | 3.31 KB | 03 Nov 2008 - 13:13 |
| Web Core / Roots | 1 | 2.78 KB | 13 Nov 2008 - 01:58 |
| Python-urllib | 1 | 294.59 KB | 27 Nov 2008 - 15:07 |
| Unknown robot (identified by 'checker') | 1 | 3.82 KB | 01 Nov 2008 - 01:08 |