| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 18035+237 | 273.04 MB | 31 Mar 2011 - 19:56 |
| Yahoo Slurp | 4460+72 | 797.13 MB | 31 Mar 2011 - 23:46 |
| Unknown robot (identified by 'bot*') | 3593+846 | 429.67 MB | 31 Mar 2011 - 22:07 |
| Googlebot | 3535+57 | 367.83 MB | 31 Mar 2011 - 23:38 |
| Unknown robot (identified by 'robot') | 2039+32 | 80.57 MB | 31 Mar 2011 - 11:31 |
| Custo | 722+51 | 25.56 MB | 31 Mar 2011 - 21:33 |
| Yandex bot | 240+37 | 48.07 MB | 31 Mar 2011 - 21:34 |
| Java (Often spam bot) | 226 | 1.31 MB | 31 Mar 2011 - 19:07 |
| WordPress | 213 | 1.13 MB | 20 Mar 2011 - 23:22 |
| Unknown robot (identified by empty user agent string) | 158+53 | 30.30 MB | 31 Mar 2011 - 23:59 |
| Voila | 124+50 | 9.09 MB | 31 Mar 2011 - 22:59 |
| Harvest | 148 | 349.22 KB | 31 Mar 2011 - 16:37 |
| Unknown robot (identified by 'discovery') | 110+37 | 9.93 MB | 31 Mar 2011 - 23:59 |
| BaiDuSpider | 104+36 | 7.85 MB | 31 Mar 2011 - 13:38 |
| Speedy Spider | 41+40 | 234.39 KB | 30 Mar 2011 - 21:01 |
| Unknown robot (identified by hit on 'robots.txt') | 0+74 | 6.36 KB | 31 Mar 2011 - 18:48 |
| MJ12bot | 35+32 | 187.82 KB | 31 Mar 2011 - 11:07 |
| Sogou Spider | 56+6 | 6.20 MB | 31 Mar 2011 - 21:24 |
| Nutch | 39+22 | 427.61 KB | 27 Mar 2011 - 20:58 |
| MSNBot | 50+8 | 218.88 KB | 31 Mar 2011 - 13:07 |
| Unknown robot (identified by 'spider') | 40+9 | 466.81 KB | 31 Mar 2011 - 14:40 |
| Unknown robot (identified by '*bot') | 14+16 | 50.39 KB | 30 Mar 2011 - 20:53 |
| Exabot | 16+12 | 80.73 KB | 31 Mar 2011 - 04:26 |
| Jakarta commons-httpclient | 25 | 12.17 MB | 31 Mar 2011 - 02:52 |
| Findlinks | 10+8 | 95.91 KB | 31 Mar 2011 - 18:04 |
| ichiro | 13+3 | 78.14 KB | 29 Mar 2011 - 11:04 |
| Perl tool | 11 | 25.01 KB | 30 Mar 2011 - 20:30 |
| BSpider | 4+5 | 16.52 KB | 28 Mar 2011 - 13:30 |
| yacy | 8 | 1.04 MB | 15 Mar 2011 - 04:10 |
| Ask | 4+4 | 352 Bytes | 23 Mar 2011 - 04:05 |
| WGet tools | 5 | 10.85 MB | 30 Mar 2011 - 20:22 |
| Heritrix | 4+1 | 34.20 KB | 13 Mar 2011 - 03:13 |
| bender focused_crawler | 0+4 | 352 Bytes | 23 Mar 2011 - 16:39 |
| YahooSeeker Yahoo! Blog crawler | 0+3 | 264 Bytes | 23 Mar 2011 - 00:28 |
| MSNBot-media | 2+1 | 11.22 KB | 08 Mar 2011 - 16:20 |
| DoCoMo | 2+1 | 3.93 KB | 03 Mar 2011 - 17:48 |
| HTMLParser | 2 | 8.04 KB | 31 Mar 2011 - 00:59 |
| GigaBot | 1+1 | 4.11 KB | 26 Mar 2011 - 14:05 |
| Netcraft | 2 | 8.04 KB | 28 Mar 2011 - 10:52 |
| Checkbot | 1 | 0 | 14 Mar 2011 - 15:27 |
| CFNetwork | 1 | 9.35 KB | 06 Mar 2011 - 15:16 |