| 39 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 43250+671 | 406.47 MB | 31 Aug 2010 - 20:34 |
| Googlebot | 6621+61 | 735.44 MB | 31 Aug 2010 - 22:38 |
| Yahoo Slurp | 4232+68 | 752.29 MB | 31 Aug 2010 - 23:50 |
| Unknown robot (identified by 'bot*') | 2724+97 | 132.37 MB | 31 Aug 2010 - 16:08 |
| MSNBot | 658+718 | 141.78 MB | 31 Aug 2010 - 23:09 |
| Heritrix | 529+4 | 256.17 MB | 30 Aug 2010 - 02:21 |
| Custo | 443+43 | 12.81 MB | 31 Aug 2010 - 14:40 |
| Ocelli | 445+1 | 157.81 MB | 15 Aug 2010 - 05:03 |
| Ask | 253+59 | 30.45 MB | 31 Aug 2010 - 18:31 |
| YahooSeeker Yahoo! Blog crawler | 222+2 | 6.96 MB | 13 Aug 2010 - 07:28 |
| Voila | 123+47 | 9.97 MB | 31 Aug 2010 - 18:22 |
| BaiDuSpider | 101+50 | 6.47 MB | 31 Aug 2010 - 15:50 |
| MSNBot-media | 101+35 | 468.39 KB | 31 Aug 2010 - 17:49 |
| Speedy Spider | 62+71 | 383.66 KB | 31 Aug 2010 - 21:27 |
| Yandex bot | 79+28 | 668.47 KB | 31 Aug 2010 - 21:31 |
| Unknown robot (identified by empty user agent string) | 80+9 | 2.63 MB | 31 Aug 2010 - 18:29 |
| Unknown robot (identified by hit on 'robots.txt') | 0+63 | 5.41 KB | 31 Aug 2010 - 07:59 |
| Harvest | 51 | 101.91 KB | 31 Aug 2010 - 21:53 |
| Java (Often spam bot) | 38+2 | 2.63 MB | 31 Aug 2010 - 01:18 |
| Nutch | 17+15 | 82.08 KB | 29 Aug 2010 - 14:34 |
| Findlinks | 22+2 | 153.17 KB | 28 Aug 2010 - 20:58 |
| Unknown robot (identified by 'spider') | 10+10 | 1.27 MB | 29 Aug 2010 - 12:33 |
| Jakarta commons-httpclient | 18 | 36.84 KB | 26 Aug 2010 - 06:33 |
| Exabot | 8+9 | 42.50 KB | 24 Aug 2010 - 15:50 |
| Mail.ru bot | 12+4 | 35.91 KB | 22 Aug 2010 - 16:45 |
| Unknown robot (identified by 'robot') | 8+6 | 38.90 KB | 30 Aug 2010 - 21:15 |
| Perl tool | 8 | 16.79 KB | 25 Aug 2010 - 20:01 |
| Alexa (IA Archiver) | 5+2 | 462.05 KB | 14 Aug 2010 - 09:47 |
| WGet tools | 6 | 6.32 MB | 29 Aug 2010 - 09:59 |
| Voyager | 3+2 | 12.24 KB | 16 Aug 2010 - 02:18 |
| Sogou Spider | 5 | 82.89 KB | 31 Aug 2010 - 19:06 |
| Unknown robot (identified by 'discovery') | 2+2 | 9.71 KB | 13 Aug 2010 - 01:05 |
| yacy | 2+1 | 244.26 KB | 31 Aug 2010 - 05:33 |
| HTTrack off-line browser | 2 | 6.63 KB | 03 Aug 2010 - 16:39 |
| BBot | 2 | 1.36 MB | 31 Aug 2010 - 01:18 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 07 Aug 2010 - 21:34 |
| Python-urllib | 1 | 4.02 KB | 18 Aug 2010 - 15:09 |
| legs | 0+1 | 88 Bytes | 09 Aug 2010 - 16:12 |
| Netcraft | 1 | 4.02 KB | 10 Aug 2010 - 20:55 |