| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 33428+549 | 91.68 MB | 31 Dec 2009 - 21:09 |
| Yahoo Slurp | 3100+68 | 594.26 MB | 31 Dec 2009 - 23:53 |
| MSNBot | 2273+445 | 28.16 MB | 31 Dec 2009 - 23:53 |
| Googlebot | 1049+47 | 160.76 MB | 31 Dec 2009 - 23:24 |
| Yandex bot | 468+44 | 9.86 MB | 31 Dec 2009 - 17:23 |
| Custo | 350+50 | 9.90 MB | 31 Dec 2009 - 11:58 |
| Voila | 178+67 | 2.78 MB | 31 Dec 2009 - 20:46 |
| Unknown robot (identified by 'bot*') | 107+78 | 31.16 MB | 31 Dec 2009 - 15:07 |
| twiceler | 120+53 | 34.51 MB | 31 Dec 2009 - 04:21 |
| Java (Often spam bot) | 171 | 690.80 KB | 31 Dec 2009 - 18:04 |
| YahooSeeker Yahoo! Blog crawler | 152+1 | 1.27 MB | 14 Dec 2009 - 11:49 |
| Ask | 83+43 | 28.06 MB | 31 Dec 2009 - 03:19 |
| Speedy Spider | 69+53 | 214.24 KB | 31 Dec 2009 - 23:23 |
| Unknown robot (identified by hit on 'robots.txt') | 0+120 | 10.31 KB | 31 Dec 2009 - 07:17 |
| Exabot | 76+40 | 6.85 MB | 31 Dec 2009 - 19:15 |
| Harvest | 86 | 139.16 KB | 31 Dec 2009 - 22:06 |
| BaiDuSpider | 41+40 | 1.11 MB | 31 Dec 2009 - 16:28 |
| Jakarta commons-httpclient | 74 | 154.27 KB | 31 Dec 2009 - 05:25 |
| Unknown robot (identified by empty user agent string) | 55+10 | 6.57 MB | 31 Dec 2009 - 09:42 |
| Turn It In | 49+2 | 1.68 MB | 22 Dec 2009 - 11:02 |
| Unknown robot (identified by 'spider') | 28+16 | 154.60 KB | 30 Dec 2009 - 06:19 |
| Mail.ru bot | 15+15 | 58.61 KB | 24 Dec 2009 - 19:14 |
| Unknown robot (identified by 'robot') | 14+14 | 6.17 MB | 31 Dec 2009 - 16:04 |
| Heritrix | 14+13 | 105.70 KB | 31 Dec 2009 - 23:19 |
| Nutch | 8+8 | 674.51 KB | 31 Dec 2009 - 17:34 |
| MJ12bot | 13+1 | 115.88 KB | 02 Dec 2009 - 02:28 |
| Alexa (IA Archiver) | 5+5 | 34.45 KB | 28 Dec 2009 - 19:54 |
| MSNBot-media | 4+3 | 13.38 KB | 31 Dec 2009 - 21:37 |
| Voyager | 5+2 | 37.54 KB | 31 Dec 2009 - 17:38 |
| Spiderman | 3+3 | 11.72 KB | 21 Dec 2009 - 16:35 |
| larbin | 3+2 | 16.51 KB | 29 Dec 2009 - 07:57 |
| WGet tools | 4 | 252.88 KB | 28 Dec 2009 - 16:25 |
| legs | 2+2 | 7.81 KB | 15 Dec 2009 - 17:54 |
| UCSD Crawl | 2 | 7.64 KB | 28 Dec 2009 - 04:53 |
| psbot | 1+1 | 88 Bytes | 03 Dec 2009 - 13:21 |
| Perl tool | 2 | 7.64 KB | 28 Dec 2009 - 22:16 |
| yacy | 2 | 266.93 KB | 09 Dec 2009 - 21:46 |
| Powermarks | 1 | 9.38 KB | 09 Dec 2009 - 04:44 |
| CFNetwork | 1 | 147.61 KB | 19 Dec 2009 - 17:46 |
| BBot | 1 | 3.82 KB | 01 Dec 2009 - 07:20 |
| QihooBot | 1 | 3.82 KB | 07 Dec 2009 - 23:28 |
| Sogou Spider | 1 | 3.82 KB | 23 Dec 2009 - 23:37 |
| Netcraft | 1 | 3.82 KB | 11 Dec 2009 - 20:18 |