| 36 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 5491+396 | 211.34 MB | 30 Jun 2010 - 23:43 |
| Yahoo Slurp | 758+60 | 12.25 MB | 30 Jun 2010 - 23:35 |
| Googlebot | 744+31 | 8.06 MB | 30 Jun 2010 - 21:13 |
| twiceler | 103+441 | 6.54 MB | 30 Jun 2010 - 10:18 |
| MSNBot | 170+193 | 1.08 MB | 30 Jun 2010 - 23:46 |
| Yandex bot | 144+12 | 10.35 MB | 30 Jun 2010 - 09:25 |
| Java (Often spam bot) | 149+1 | 931.61 KB | 30 Jun 2010 - 20:34 |
| Heritrix | 123+1 | 6.79 MB | 24 Jun 2010 - 04:41 |
| Perl tool | 115 | 427.15 KB | 30 Jun 2010 - 19:20 |
| BaiDuSpider | 61+30 | 192.99 KB | 30 Jun 2010 - 22:25 |
| Unknown robot (identified by empty user agent string) | 85+2 | 2.28 MB | 28 Jun 2010 - 01:46 |
| Mail.ru bot | 70+1 | 5.26 MB | 16 Jun 2010 - 14:25 |
| Harvest | 65 | 187.63 KB | 29 Jun 2010 - 16:34 |
| MSNBot-media | 37+27 | 157.28 KB | 30 Jun 2010 - 21:17 |
| Unknown robot (identified by hit on 'robots.txt') | 0+33 | 2.84 KB | 30 Jun 2010 - 04:58 |
| Unknown robot (identified by 'bot*') | 15+10 | 216.98 KB | 29 Jun 2010 - 04:52 |
| Unknown robot (identified by 'discovery') | 3+19 | 9.34 KB | 18 Jun 2010 - 14:04 |
| Voila | 15+5 | 143.02 KB | 30 Jun 2010 - 20:07 |
| Unknown robot (identified by 'robot') | 19+1 | 83.78 KB | 01 Jun 2010 - 10:16 |
| Speedy Spider | 10+10 | 91.47 KB | 25 Jun 2010 - 12:34 |
| Ask | 9+8 | 64.04 KB | 22 Jun 2010 - 19:11 |
| Jakarta commons-httpclient | 16 | 12.81 KB | 24 Jun 2010 - 14:21 |
| Exabot | 10+4 | 52.91 KB | 29 Jun 2010 - 18:46 |
| Alexa (IA Archiver) | 2+2 | 6.67 KB | 23 Jun 2010 - 22:29 |
| MJ12bot | 1+2 | 8.65 KB | 27 Jun 2010 - 00:07 |
| Unknown robot (identified by 'spider') | 1+1 | 5.35 KB | 10 Jun 2010 - 23:22 |
| Gaisbot | 1+1 | 3.37 KB | 29 Jun 2010 - 22:15 |
| DoCoMo | 1+1 | 3.31 KB | 08 Jun 2010 - 04:37 |
| Nutch | 1+1 | 2.85 KB | 09 Jun 2010 - 06:14 |
| WebReaper | 1+1 | 3.37 KB | 27 Jun 2010 - 05:52 |
| BBot | 1+1 | 3.11 KB | 01 Jun 2010 - 13:32 |
| VSE | 0+1 | 88 Bytes | 27 Jun 2010 - 03:22 |
| WGet tools | 1 | 93.48 KB | 05 Jun 2010 - 14:09 |
| webcompass | 1 | 3.22 KB | 04 Jun 2010 - 10:56 |
| yacy | 1 | 93.48 KB | 13 Jun 2010 - 08:46 |
| Python-urllib | 0+1 | 88 Bytes | 14 Jun 2010 - 04:31 |