| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 59928+903 | 511.44 MB | 31 Jul 2010 - 22:38 |
| Googlebot | 5543+59 | 189.11 MB | 31 Jul 2010 - 23:58 |
| Yahoo Slurp | 4362+74 | 717.66 MB | 31 Jul 2010 - 23:50 |
| MSNBot | 787+610 | 136.57 MB | 31 Jul 2010 - 21:34 |
| Unknown robot (identified by 'bot*') | 493+123 | 52.71 MB | 31 Jul 2010 - 23:25 |
| archive.org bot | 541+2 | 256.08 MB | 04 Jul 2010 - 01:30 |
| Unknown robot (identified by 'discovery') | 423+99 | 14.56 MB | 15 Jul 2010 - 10:41 |
| Custo | 402+43 | 9.78 MB | 31 Jul 2010 - 13:42 |
| Unknown robot (identified by empty user agent string) | 250+20 | 19.95 MB | 31 Jul 2010 - 17:07 |
| Heritrix | 261+1 | 23.23 MB | 29 Jul 2010 - 07:38 |
| Ask | 127+79 | 33.50 MB | 31 Jul 2010 - 19:14 |
| Turn It In | 193+1 | 6.89 MB | 18 Jul 2010 - 21:13 |
| Voila | 103+44 | 6.88 MB | 31 Jul 2010 - 23:27 |
| MSNBot-media | 104+34 | 524.35 KB | 31 Jul 2010 - 06:41 |
| Jakarta commons-httpclient | 134+1 | 648.31 KB | 31 Jul 2010 - 09:33 |
| Speedy Spider | 69+63 | 620.80 KB | 29 Jul 2010 - 05:34 |
| Yandex bot | 77+33 | 653.53 KB | 31 Jul 2010 - 20:26 |
| BaiDuSpider | 47+37 | 18.21 MB | 30 Jul 2010 - 11:26 |
| Harvest | 78 | 384.00 KB | 31 Jul 2010 - 02:28 |
| Unknown robot (identified by hit on 'robots.txt') | 0+77 | 6.62 KB | 30 Jul 2010 - 02:52 |
| Java (Often spam bot) | 61+1 | 636.90 KB | 31 Jul 2010 - 02:37 |
| Nutch | 26+21 | 122.38 KB | 31 Jul 2010 - 10:59 |
| MJ12bot | 44+2 | 343.35 KB | 25 Jul 2010 - 16:54 |
| twiceler | 0+43 | 3.70 KB | 30 Jul 2010 - 04:49 |
| Unknown robot (identified by 'spider') | 28+10 | 353.83 KB | 25 Jul 2010 - 01:57 |
| Unknown robot (identified by 'robot') | 27+8 | 127.22 KB | 24 Jul 2010 - 23:11 |
| Exabot | 15+15 | 60.50 KB | 30 Jul 2010 - 00:32 |
| Mail.ru bot | 9+3 | 26.93 KB | 26 Jul 2010 - 17:15 |
| WGet tools | 11 | 1.30 MB | 28 Jul 2010 - 00:37 |
| Perl tool | 6 | 16.44 KB | 24 Jul 2010 - 23:56 |
| Voyager | 4+2 | 16.26 KB | 23 Jul 2010 - 21:51 |
| yacy | 3+1 | 271.04 KB | 22 Jul 2010 - 01:28 |
| larbin | 2+2 | 13.09 KB | 12 Jul 2010 - 11:34 |
| Sogou Spider | 3 | 8.48 KB | 30 Jul 2010 - 11:18 |
| Alexa (IA Archiver) | 1+1 | 3.15 KB | 26 Jul 2010 - 08:32 |
| Findlinks | 1+1 | 5.61 KB | 08 Jul 2010 - 06:18 |
| Unknown robot (identified by 'hunter') | 1 | 7.13 KB | 02 Jul 2010 - 07:36 |
| Allrati | 1 | 4.02 KB | 01 Jul 2010 - 21:39 |
| Python-urllib | 1 | 3.31 KB | 01 Jul 2010 - 12:41 |
| FavIconizer | 1 | 4.02 KB | 16 Jul 2010 - 14:17 |
| BBot | 1 | 748.34 KB | 10 Jul 2010 - 08:55 |