| 36 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 7095+443 | 210.46 MB | 30 Jun 2010 - 23:48 |
| MSNBot-media | 36+20 | 154.57 KB | 30 Jun 2010 - 23:16 |
| Googlebot | 2411+50 | 75.13 MB | 30 Jun 2010 - 22:53 |
| Yahoo Slurp | 907+60 | 34.93 MB | 30 Jun 2010 - 21:49 |
| BaiDuSpider | 50+28 | 206.88 KB | 30 Jun 2010 - 21:22 |
| Perl tool | 11 | 21.55 KB | 30 Jun 2010 - 19:57 |
| MSNBot | 253+190 | 4.92 MB | 30 Jun 2010 - 19:41 |
| Voila | 18+10 | 38.88 KB | 30 Jun 2010 - 16:40 |
| twiceler | 160+349 | 10.22 MB | 30 Jun 2010 - 13:39 |
| Yandex bot | 132+13 | 9.07 MB | 30 Jun 2010 - 12:13 |
| Harvest | 64 | 79.98 KB | 30 Jun 2010 - 07:18 |
| Java (Often spam bot) | 27 | 18.50 KB | 30 Jun 2010 - 04:27 |
| Alexa (IA Archiver) | 2+1 | 6.64 KB | 30 Jun 2010 - 00:47 |
| Gaisbot | 1+1 | 3.50 KB | 29 Jun 2010 - 23:21 |
| Unknown robot (identified by 'discovery') | 66+68 | 401.37 KB | 29 Jun 2010 - 21:54 |
| Sogou Spider | 1 | 3.45 KB | 29 Jun 2010 - 21:30 |
| Unknown robot (identified by empty user agent string) | 22+5 | 101.69 KB | 29 Jun 2010 - 21:22 |
| Ask | 27+22 | 432.08 KB | 29 Jun 2010 - 14:17 |
| Unknown robot (identified by hit on 'robots.txt') | 0+30 | 2.58 KB | 29 Jun 2010 - 09:26 |
| Unknown robot (identified by 'bot*') | 43+24 | 115.25 KB | 27 Jun 2010 - 09:35 |
| WebReaper | 1+1 | 3.50 KB | 27 Jun 2010 - 05:48 |
| Speedy Spider | 9+7 | 36.52 KB | 24 Jun 2010 - 22:49 |
| Jakarta commons-httpclient | 18 | 22.57 KB | 24 Jun 2010 - 14:48 |
| Heritrix | 157+1 | 14.82 MB | 24 Jun 2010 - 05:14 |
| Python-urllib | 1 | 313.00 KB | 24 Jun 2010 - 02:30 |
| Exabot | 44+3 | 232.49 KB | 24 Jun 2010 - 00:03 |
| Custo | 7+7 | 27.49 KB | 22 Jun 2010 - 15:41 |
| yacy | 2 | 43.77 KB | 13 Jun 2010 - 09:27 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 10 Jun 2010 - 15:47 |
| Netcraft | 1 | 3.45 KB | 08 Jun 2010 - 20:38 |
| Unknown robot (identified by 'spider') | 6+2 | 21.49 KB | 07 Jun 2010 - 05:48 |
| Nutch | 0+1 | 88 Bytes | 06 Jun 2010 - 06:08 |
| webcompass | 1 | 3.45 KB | 04 Jun 2010 - 19:40 |
| Unknown robot (identified by 'robot') | 85+1 | 5.27 MB | 03 Jun 2010 - 19:20 |
| BBot | 1+1 | 3.34 KB | 01 Jun 2010 - 21:27 |
| psbot | 42+2 | 259.79 KB | 01 Jun 2010 - 10:06 |