| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 19314+1749 | 276.51 MB | 31 Oct 2011 - 17:45 |
| Googlebot | 4971+197 | 591.20 MB | 31 Oct 2011 - 17:48 |
| Yahoo Slurp | 3241+92 | 657.54 MB | 29 Oct 2011 - 09:43 |
| Unknown robot (identified by 'robot') | 2092+22 | 96.49 MB | 29 Oct 2011 - 22:02 |
| Unknown robot (identified by 'bot*') | 632+348 | 159.60 MB | 31 Oct 2011 - 17:14 |
| BaiDuSpider | 568+84 | 8.61 MB | 31 Oct 2011 - 16:11 |
| Custo | 547+36 | 20.38 MB | 31 Oct 2011 - 13:19 |
| Heritrix | 558+1 | 257.39 MB | 12 Oct 2011 - 11:42 |
| Yandex bot | 417+30 | 93.51 MB | 31 Oct 2011 - 14:38 |
| Sogou Spider | 372+4 | 6.89 MB | 31 Oct 2011 - 08:11 |
| psbot | 301+9 | 7.80 MB | 29 Oct 2011 - 20:13 |
| Unknown robot (identified by 'spider') | 207+29 | 8.54 MB | 31 Oct 2011 - 15:43 |
| Jakarta commons-httpclient | 192 | 8.11 MB | 31 Oct 2011 - 12:15 |
| Voila | 136+52 | 9.78 MB | 31 Oct 2011 - 16:34 |
| Unknown robot (identified by empty user agent string) | 173+2 | 3.57 MB | 31 Oct 2011 - 16:33 |
| Nutch | 120+46 | 9.62 MB | 28 Oct 2011 - 19:38 |
| MJ12bot | 55+69 | 292.50 KB | 31 Oct 2011 - 11:23 |
| Unknown robot (identified by hit on 'robots.txt') | 0+122 | 10.48 KB | 31 Oct 2011 - 15:51 |
| Speedy Spider | 59+55 | 620.69 KB | 30 Oct 2011 - 20:17 |
| Perl tool | 105 | 588.75 KB | 31 Oct 2011 - 17:59 |
| Harvest | 81 | 189.99 KB | 31 Oct 2011 - 08:26 |
| Java (Often spam bot) | 61 | 952.77 KB | 21 Oct 2011 - 10:41 |
| Unknown robot (identified by '*bot') | 12+23 | 52.13 KB | 31 Oct 2011 - 11:52 |
| OutfoxBot/YodaoBot | 21+1 | 72.49 KB | 26 Oct 2011 - 10:53 |
| Unknown robot (identified by 'discovery') | 21 | 83.78 KB | 31 Oct 2011 - 17:54 |
| Findlinks | 6+6 | 33.63 KB | 26 Oct 2011 - 07:38 |
| Netcraft | 12 | 28.16 KB | 28 Oct 2011 - 21:03 |
| MSNBot-media | 6+3 | 26.19 KB | 20 Oct 2011 - 04:39 |
| Exabot | 3+6 | 16.32 KB | 17 Oct 2011 - 04:39 |
| DoCoMo | 1+7 | 4.62 KB | 30 Oct 2011 - 20:43 |
| WGet tools | 5 | 1.28 MB | 20 Oct 2011 - 23:06 |
| Alexa (IA Archiver) | 2+3 | 12.69 KB | 25 Oct 2011 - 01:01 |
| yacy | 2+2 | 9.09 KB | 13 Oct 2011 - 21:09 |
| GigaBot | 0+4 | 352 Bytes | 22 Oct 2011 - 06:11 |
| HTTrack off-line browser | 2+2 | 8.22 KB | 30 Oct 2011 - 11:24 |
| HTMLParser | 3 | 12.07 KB | 27 Oct 2011 - 19:33 |
| Python-urllib | 3 | 12.07 KB | 17 Oct 2011 - 08:18 |
| larbin | 2+1 | 12.87 KB | 20 Oct 2011 - 21:23 |
| Unknown robot (identified by 'checker') | 3 | 0 | 27 Oct 2011 - 15:10 |
| archive.org bot | 1+1 | 4.11 KB | 12 Oct 2011 - 03:47 |
| Pioneer | 1 | 4.02 KB | 30 Oct 2011 - 10:13 |