| 40 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 44458+541 | 345.21 MB | 30 Nov 2009 - 08:05 |
| Googlebot | 4434+52 | 1.02 GB | 30 Nov 2009 - 23:55 |
| Yahoo Slurp | 3414+93 | 606.33 MB | 30 Nov 2009 - 23:39 |
| MSNBot | 2463+404 | 31.66 MB | 30 Nov 2009 - 23:31 |
| Custo | 467+82 | 34.36 MB | 30 Nov 2009 - 12:25 |
| Heritrix | 471+7 | 250.58 MB | 22 Nov 2009 - 08:30 |
| Unknown robot (identified by 'bot*') | 242+69 | 24.68 MB | 30 Nov 2009 - 15:07 |
| Yandex bot | 259+30 | 3.81 MB | 30 Nov 2009 - 19:18 |
| Ask | 163+57 | 25.97 MB | 30 Nov 2009 - 19:47 |
| Voila | 156+55 | 3.62 MB | 30 Nov 2009 - 21:47 |
| Unknown robot (identified by hit on 'robots.txt') | 0+179 | 15.38 KB | 30 Nov 2009 - 17:52 |
| Java (Often spam bot) | 137+1 | 1.53 MB | 27 Nov 2009 - 15:25 |
| Exabot | 100+26 | 10.97 MB | 29 Nov 2009 - 18:19 |
| Turn It In | 123+2 | 13.35 MB | 18 Nov 2009 - 02:45 |
| BaiDuSpider | 77+34 | 307.79 KB | 30 Nov 2009 - 21:29 |
| Unknown robot (identified by empty user agent string) | 89+12 | 2.89 MB | 30 Nov 2009 - 23:36 |
| Speedy Spider | 58+32 | 125.15 KB | 28 Nov 2009 - 23:09 |
| Harvest | 72 | 109.53 KB | 30 Nov 2009 - 02:13 |
| twiceler | 42+28 | 1.22 MB | 30 Nov 2009 - 01:26 |
| Unknown robot (identified by 'spider') | 19+16 | 84.32 KB | 29 Nov 2009 - 00:52 |
| GigaBot | 16+15 | 62.43 KB | 21 Nov 2009 - 07:51 |
| Mail.ru bot | 15+15 | 58.61 KB | 30 Nov 2009 - 07:05 |
| Jakarta commons-httpclient | 26 | 12.57 MB | 30 Nov 2009 - 07:09 |
| MJ12bot | 24+2 | 183.33 KB | 11 Nov 2009 - 07:43 |
| Unknown robot (identified by 'robot') | 14+10 | 5.13 MB | 28 Nov 2009 - 08:55 |
| Nutch | 9+10 | 32.37 KB | 25 Nov 2009 - 17:39 |
| Steeler | 14+2 | 164.28 KB | 26 Nov 2009 - 17:12 |
| larbin | 11+5 | 40.10 KB | 30 Nov 2009 - 17:59 |
| WGet tools | 12+1 | 996.90 KB | 30 Nov 2009 - 04:42 |
| Alexa (IA Archiver) | 5+4 | 7.30 MB | 29 Nov 2009 - 11:18 |
| Perl tool | 7 | 23.80 KB | 16 Nov 2009 - 15:47 |
| WebReaper | 3+3 | 10.20 KB | 26 Nov 2009 - 01:39 |
| Python-urllib | 6 | 1.18 MB | 29 Nov 2009 - 16:29 |
| yacy | 2+2 | 7.31 KB | 11 Nov 2009 - 06:12 |
| DoCoMo | 0+1 | 88 Bytes | 20 Nov 2009 - 14:07 |
| Findlinks | 0+1 | 88 Bytes | 23 Nov 2009 - 16:26 |
| JoBo Java Web Robot | 0+1 | 88 Bytes | 20 Nov 2009 - 22:33 |
| BBot | 1 | 337.25 KB | 21 Nov 2009 - 09:54 |
| Netcraft | 1 | 3.82 KB | 19 Nov 2009 - 05:17 |
| Sogou Spider | 1 | 0 | 23 Nov 2009 - 21:23 |