| 44 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 4207+363 | 257.91 MB | 30 Sep 2008 - 23:53 |
| Yahoo Slurp | 3071+99 | 423.86 MB | 30 Sep 2008 - 23:51 |
| Yanga WorldSearch Bot | 2058+58 | 12.63 MB | 29 Sep 2008 - 17:49 |
| MSNBot | 1242+501 | 73.25 MB | 30 Sep 2008 - 23:51 |
| Googlebot | 1321+37 | 611.69 MB | 30 Sep 2008 - 23:21 |
| Ocelli | 444+1 | 155.97 MB | 25 Sep 2008 - 05:37 |
| Yandex bot | 308+18 | 107.91 MB | 28 Sep 2008 - 22:48 |
| Unknown robot (identified by 'bot*') | 265+48 | 17.49 MB | 30 Sep 2008 - 19:39 |
| Turn It In | 302+4 | 82.76 MB | 29 Sep 2008 - 21:40 |
| Harvest | 293 | 7.06 MB | 30 Sep 2008 - 16:36 |
| Ask | 161+49 | 8.20 MB | 30 Sep 2008 - 13:36 |
| MSNBot-media | 132+76 | 56.40 MB | 30 Sep 2008 - 22:05 |
| Java (Often spam bot) | 159 | 700.11 KB | 25 Sep 2008 - 00:42 |
| Voila | 94+40 | 59.73 MB | 30 Sep 2008 - 01:06 |
| Unknown robot (identified by hit on 'robots.txt') | 0+129 | 8.34 KB | 30 Sep 2008 - 13:02 |
| BaiDuSpider | 57+35 | 213.68 KB | 30 Sep 2008 - 16:14 |
| Netluchs | 60+7 | 659.44 KB | 11 Sep 2008 - 14:51 |
| MSIECrawler | 40+8 | 167.95 KB | 30 Sep 2008 - 10:38 |
| Unknown robot (identified by empty user agent string) | 20+21 | 1.19 MB | 27 Sep 2008 - 23:44 |
| Unknown robot (identified by 'robot') | 21+10 | 87.05 KB | 23 Sep 2008 - 13:12 |
| Speedy Spider | 17+12 | 735.18 KB | 30 Sep 2008 - 12:04 |
| Nutch | 13+10 | 650.75 KB | 30 Sep 2008 - 18:25 |
| Unknown robot (identified by 'discovery') | 19+3 | 146.68 KB | 29 Sep 2008 - 11:51 |
| BSpider | 14+4 | 352 Bytes | 30 Sep 2008 - 11:01 |
| larbin | 11+6 | 35.71 KB | 29 Sep 2008 - 00:36 |
| Gaisbot | 10+6 | 137.86 KB | 21 Sep 2008 - 12:17 |
| yacy | 8+7 | 28.64 KB | 12 Sep 2008 - 22:22 |
| GigaBot | 12+2 | 711.52 KB | 12 Sep 2008 - 10:17 |
| Unknown robot (identified by 'spider') | 6+5 | 15.10 KB | 30 Sep 2008 - 09:06 |
| twiceler | 0+11 | 968 Bytes | 29 Sep 2008 - 04:57 |
| KnowItAll | 8+2 | 28.98 KB | 20 Sep 2008 - 09:58 |
| MJ12bot | 7+3 | 56.19 KB | 22 Sep 2008 - 03:23 |
| Jakarta commons-httpclient | 8 | 12.61 KB | 29 Sep 2008 - 05:09 |
| MSRBOT | 3+3 | 7.83 KB | 24 Sep 2008 - 16:15 |
| boitho.com-dc | 3+2 | 16.13 KB | 30 Sep 2008 - 05:13 |
| YahooSeeker Yahoo! Blog crawler | 0+4 | 352 Bytes | 25 Sep 2008 - 17:13 |
| WGet tools | 3+1 | 485.62 KB | 30 Sep 2008 - 08:28 |
| Alexa (IA Archiver) | 2+2 | 345.89 KB | 14 Sep 2008 - 11:07 |
| Perl tool | 4 | 270.25 KB | 28 Sep 2008 - 08:44 |
| Heritrix | 2+2 | 11.00 KB | 17 Sep 2008 - 13:57 |
| HTMLParser | 3 | 11.46 KB | 29 Sep 2008 - 04:26 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 29 Sep 2008 - 04:57 |
| SpiderView(tm) | 1 | 3.82 KB | 24 Sep 2008 - 09:16 |
| Sogou Spider | 1 | 0 | 23 Sep 2008 - 01:56 |