| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 19447+1330 | 389.17 MB | 31 Aug 2011 - 20:44 |
| Yahoo Slurp | 3915+66 | 779.69 MB | 31 Aug 2011 - 23:59 |
| Googlebot | 2979+61 | 564.64 MB | 31 Aug 2011 - 23:27 |
| Unknown robot (identified by 'bot*') | 2343+554 | 300.34 MB | 31 Aug 2011 - 23:32 |
| Unknown robot (identified by 'robot') | 1418+12 | 59.50 MB | 30 Aug 2011 - 08:24 |
| Ocelli | 1214+4 | 753.65 MB | 21 Aug 2011 - 19:43 |
| Yandex bot | 655+41 | 201.66 MB | 31 Aug 2011 - 23:53 |
| Custo | 635+40 | 26.79 MB | 31 Aug 2011 - 19:57 |
| Sogou Spider | 519+2 | 34.04 MB | 31 Aug 2011 - 18:20 |
| Unknown robot (identified by 'spider') | 440+7 | 3.09 MB | 31 Aug 2011 - 13:53 |
| Heritrix | 417+1 | 8.48 MB | 29 Aug 2011 - 17:48 |
| Java (Often spam bot) | 348+1 | 2.76 MB | 31 Aug 2011 - 19:21 |
| BaiDuSpider | 257+48 | 88.88 MB | 31 Aug 2011 - 22:57 |
| Unknown robot (identified by 'discovery') | 124+122 | 8.98 MB | 31 Aug 2011 - 13:40 |
| Unknown robot (identified by hit on 'robots.txt') | 0+245 | 21.05 KB | 31 Aug 2011 - 13:53 |
| Unknown robot (identified by empty user agent string) | 111+91 | 34.60 MB | 30 Aug 2011 - 23:02 |
| Nutch | 137+59 | 4.20 MB | 28 Aug 2011 - 19:06 |
| Voila | 126+46 | 9.58 MB | 31 Aug 2011 - 17:21 |
| MJ12bot | 47+53 | 247.99 KB | 31 Aug 2011 - 21:19 |
| Speedy Spider | 35+39 | 338.00 KB | 30 Aug 2011 - 01:28 |
| OutfoxBot/YodaoBot | 73 | 293.64 KB | 20 Aug 2011 - 08:46 |
| Harvest | 58 | 126.62 KB | 30 Aug 2011 - 16:36 |
| Jakarta commons-httpclient | 46 | 95.01 KB | 31 Aug 2011 - 00:22 |
| Findlinks | 20+9 | 174.78 KB | 31 Aug 2011 - 01:02 |
| archive.org bot | 25+1 | 765.01 KB | 12 Aug 2011 - 23:39 |
| Exabot | 14+10 | 61.05 KB | 29 Aug 2011 - 06:38 |
| Perl tool | 17 | 863.42 KB | 31 Aug 2011 - 20:08 |
| Unknown robot (identified by '*bot') | 6+7 | 34.80 KB | 27 Aug 2011 - 21:25 |
| MSNBot-media | 6+3 | 33.69 KB | 07 Aug 2011 - 06:16 |
| DoCoMo | 6+1 | 48.97 KB | 17 Aug 2011 - 03:10 |
| Python-urllib | 7 | 14.88 KB | 28 Aug 2011 - 09:05 |
| WGet tools | 5+1 | 1.31 MB | 21 Aug 2011 - 09:20 |
| Alexa (IA Archiver) | 2+4 | 1.16 MB | 29 Aug 2011 - 12:20 |
| BSpider | 1+3 | 1.07 MB | 04 Aug 2011 - 22:45 |
| larbin | 2+1 | 12.87 KB | 14 Aug 2011 - 23:47 |
| psbot | 1+1 | 2.99 KB | 14 Aug 2011 - 08:54 |
| yacy | 1+1 | 4.11 KB | 10 Aug 2011 - 09:45 |
| Unknown robot (identified by 'checker') | 2 | 0 | 31 Aug 2011 - 14:05 |
| Netcraft | 2 | 8.04 KB | 24 Aug 2011 - 18:28 |
| bender focused_crawler | 0+1 | 88 Bytes | 18 Aug 2011 - 17:12 |
| CFNetwork | 1 | 683.39 KB | 07 Aug 2011 - 04:43 |
| FavIconizer | 1 | 4.02 KB | 16 Aug 2011 - 18:24 |
| BBot | 1 | 647.08 KB | 07 Aug 2011 - 17:50 |