| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 4081+66 | 615.74 MB | 30 Jun 2010 - 23:57 |
| MSNBot | 995+506 | 94.70 MB | 30 Jun 2010 - 23:56 |
| Unknown robot (identified by 'crawl') | 25518+595 | 285.59 MB | 30 Jun 2010 - 23:48 |
| Voila | 109+46 | 5.64 MB | 30 Jun 2010 - 23:09 |
| Googlebot | 6480+56 | 257.94 MB | 30 Jun 2010 - 22:59 |
| MSNBot-media | 83+32 | 414.35 KB | 30 Jun 2010 - 22:35 |
| Perl tool | 15 | 41.13 KB | 30 Jun 2010 - 19:57 |
| Exabot | 12+12 | 34.20 KB | 30 Jun 2010 - 18:29 |
| Custo | 430+38 | 8.27 MB | 30 Jun 2010 - 17:32 |
| Unknown robot (identified by 'bot*') | 3071+69 | 142.62 MB | 30 Jun 2010 - 15:09 |
| Ask | 112+63 | 43.36 MB | 30 Jun 2010 - 11:00 |
| Unknown robot (identified by empty user agent string) | 92+13 | 1.67 MB | 30 Jun 2010 - 07:28 |
| twiceler | 325+589 | 23.76 MB | 30 Jun 2010 - 06:04 |
| BaiDuSpider | 56+36 | 3.70 MB | 30 Jun 2010 - 05:55 |
| Java (Often spam bot) | 37+1 | 1.64 MB | 30 Jun 2010 - 05:01 |
| Harvest | 72 | 120.66 KB | 30 Jun 2010 - 02:18 |
| Unknown robot (identified by hit on 'robots.txt') | 0+69 | 5.93 KB | 30 Jun 2010 - 02:16 |
| Yandex bot | 184+33 | 9.16 MB | 30 Jun 2010 - 01:53 |
| WGet tools | 5+1 | 1006.34 KB | 30 Jun 2010 - 00:37 |
| Unknown robot (identified by 'spider') | 26+4 | 90.93 KB | 29 Jun 2010 - 23:20 |
| Gaisbot | 1+1 | 3.40 KB | 29 Jun 2010 - 22:10 |
| Unknown robot (identified by 'discovery') | 554+181 | 11.05 MB | 29 Jun 2010 - 21:55 |
| Alexa (IA Archiver) | 8+6 | 1.37 MB | 29 Jun 2010 - 21:43 |
| Nutch | 17+16 | 68.92 KB | 29 Jun 2010 - 17:30 |
| legs | 0+3 | 264 Bytes | 29 Jun 2010 - 14:38 |
| Unknown robot (identified by 'robot') | 515+11 | 27.75 MB | 29 Jun 2010 - 13:21 |
| Findlinks | 11 | 84.78 KB | 29 Jun 2010 - 11:36 |
| Sogou Spider | 1 | 0 | 29 Jun 2010 - 10:20 |
| BBot | 2+1 | 650.98 KB | 29 Jun 2010 - 08:06 |
| Jakarta commons-httpclient | 22+3 | 56.19 KB | 28 Jun 2010 - 03:10 |
| WebReaper | 1+1 | 3.40 KB | 27 Jun 2010 - 05:48 |
| Heritrix | 527+4 | 256.04 MB | 26 Jun 2010 - 06:38 |
| Speedy Spider | 27+28 | 168.67 KB | 25 Jun 2010 - 05:23 |
| Python-urllib | 1 | 1.07 MB | 24 Jun 2010 - 02:46 |
| yacy | 5+1 | 537.97 KB | 23 Jun 2010 - 09:25 |
| Mail.ru bot | 71+1 | 5.46 MB | 16 Jun 2010 - 14:25 |
| Netcraft | 1 | 4.02 KB | 08 Jun 2010 - 20:23 |
| CFNetwork | 3 | 11.39 MB | 07 Jun 2010 - 02:43 |
| lwp-request | 1 | 0 | 05 Jun 2010 - 23:53 |
| Ocelli | 445+1 | 157.77 MB | 05 Jun 2010 - 12:04 |
| webcompass | 1 | 4.02 KB | 04 Jun 2010 - 18:41 |
| Spiderman | 1+1 | 3.91 KB | 01 Jun 2010 - 19:01 |