| 34 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 5607+797 | 222.27 MB | 31 Aug 2011 - 22:11 |
| Unknown robot (identified by 'robot') | 1039+6 | 17.77 MB | 29 Aug 2011 - 14:33 |
| Yahoo Slurp | 964+62 | 22.64 MB | 31 Aug 2011 - 23:59 |
| Java (Often spam bot) | 864 | 15.12 MB | 31 Aug 2011 - 20:39 |
| Googlebot | 786+49 | 13.87 MB | 31 Aug 2011 - 23:54 |
| Unknown robot (identified by 'spider') | 275+2 | 713.86 KB | 31 Aug 2011 - 04:13 |
| Unknown robot (identified by 'bot*') | 175+67 | 6.29 MB | 30 Aug 2011 - 09:25 |
| Jakarta commons-httpclient | 195 | 438.73 KB | 31 Aug 2011 - 18:50 |
| Unknown robot (identified by 'discovery') | 49+124 | 2.05 MB | 31 Aug 2011 - 09:53 |
| Unknown robot (identified by hit on 'robots.txt') | 0+171 | 14.70 KB | 31 Aug 2011 - 04:13 |
| Heritrix | 130+1 | 6.73 MB | 29 Aug 2011 - 16:22 |
| psbot | 127+3 | 6.68 MB | 18 Aug 2011 - 15:55 |
| BaiDuSpider | 96+19 | 310.24 KB | 31 Aug 2011 - 17:25 |
| Yandex bot | 73+27 | 954.52 KB | 31 Aug 2011 - 23:05 |
| Nutch | 54+25 | 240.65 KB | 29 Aug 2011 - 22:22 |
| Harvest | 72 | 192.75 KB | 31 Aug 2011 - 18:01 |
| Unknown robot (identified by '*bot') | 25+26 | 90.24 KB | 31 Aug 2011 - 05:07 |
| Unknown robot (identified by empty user agent string) | 26+4 | 493.14 KB | 30 Aug 2011 - 16:41 |
| Speedy Spider | 15+13 | 170.63 KB | 30 Aug 2011 - 00:52 |
| Voila | 21+5 | 252.20 KB | 31 Aug 2011 - 15:53 |
| archive.org bot | 22+1 | 100.46 KB | 18 Aug 2011 - 21:01 |
| Perl tool | 14 | 29.82 KB | 31 Aug 2011 - 19:32 |
| DoCoMo | 6+4 | 41.76 KB | 29 Aug 2011 - 20:23 |
| Findlinks | 6+4 | 27.66 KB | 31 Aug 2011 - 04:01 |
| MJ12bot | 5+5 | 16.69 KB | 22 Aug 2011 - 14:58 |
| Exabot | 4+4 | 15.77 KB | 29 Aug 2011 - 19:11 |
| WordPress | 6 | 101.03 KB | 28 Aug 2011 - 01:45 |
| WGet tools | 2+1 | 184.10 KB | 21 Aug 2011 - 09:06 |
| Sogou Spider | 3 | 3.22 KB | 17 Aug 2011 - 21:26 |
| GigaBot | 1+1 | 3.31 KB | 13 Aug 2011 - 14:48 |
| Python-urllib | 2 | 6.44 KB | 12 Aug 2011 - 10:07 |
| legs | 1+1 | 3.31 KB | 16 Aug 2011 - 20:50 |
| larbin | 1+1 | 3.31 KB | 13 Aug 2011 - 15:52 |
| Netcraft | 1 | 3.22 KB | 24 Aug 2011 - 16:30 |