| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 19088+195 | 288.42 MB | 30 Apr 2011 - 23:57 |
| Googlebot | 4729+59 | 694.30 MB | 30 Apr 2011 - 23:52 |
| Yahoo Slurp | 4098+83 | 753.88 MB | 30 Apr 2011 - 23:35 |
| Unknown robot (identified by 'discovery') | 1349+1407 | 107.45 MB | 30 Apr 2011 - 03:13 |
| Unknown robot (identified by empty user agent string) | 1951+60 | 27.32 MB | 30 Apr 2011 - 20:05 |
| Unknown robot (identified by 'bot*') | 1046+654 | 178.17 MB | 30 Apr 2011 - 21:32 |
| Unknown robot (identified by 'robot') | 977+15 | 27.64 MB | 30 Apr 2011 - 10:13 |
| Custo | 675+51 | 28.81 MB | 30 Apr 2011 - 17:06 |
| Yandex bot | 638+52 | 58.18 MB | 30 Apr 2011 - 16:25 |
| Heritrix | 536+3 | 256.87 MB | 20 Apr 2011 - 23:20 |
| Ocelli | 536+1 | 256.84 MB | 24 Apr 2011 - 20:19 |
| BaiDuSpider | 247+37 | 2.68 MB | 30 Apr 2011 - 22:30 |
| MJ12bot | 192+44 | 934.67 KB | 30 Apr 2011 - 21:25 |
| Java (Often spam bot) | 200 | 1.51 MB | 28 Apr 2011 - 18:49 |
| MSNBot | 153+19 | 672.04 KB | 27 Apr 2011 - 23:00 |
| Voila | 101+38 | 8.75 MB | 30 Apr 2011 - 17:03 |
| ichiro | 104+10 | 493.09 KB | 30 Apr 2011 - 23:49 |
| Speedy Spider | 54+53 | 1.80 MB | 30 Apr 2011 - 12:28 |
| Unknown robot (identified by 'spider') | 98+6 | 3.58 MB | 30 Apr 2011 - 18:40 |
| Harvest | 91 | 414.21 KB | 30 Apr 2011 - 17:59 |
| Unknown robot (identified by hit on 'robots.txt') | 0+90 | 7.73 KB | 30 Apr 2011 - 16:44 |
| Sogou Spider | 64+6 | 6.46 MB | 29 Apr 2011 - 22:58 |
| Nutch | 27+16 | 229.54 KB | 29 Apr 2011 - 23:08 |
| Jakarta commons-httpclient | 41 | 6.25 MB | 28 Apr 2011 - 00:44 |
| Unknown robot (identified by '*bot') | 16+19 | 59.66 KB | 28 Apr 2011 - 11:17 |
| Exabot | 20+10 | 113.33 KB | 30 Apr 2011 - 21:11 |
| Findlinks | 20+10 | 282.34 KB | 30 Apr 2011 - 04:37 |
| Alexa (IA Archiver) | 15+5 | 71.24 KB | 26 Apr 2011 - 15:36 |
| Steeler | 14+1 | 407.52 KB | 11 Apr 2011 - 09:57 |
| Perl tool | 10 | 27.75 KB | 26 Apr 2011 - 03:41 |
| BSpider | 0+6 | 528 Bytes | 30 Apr 2011 - 17:16 |
| Python-urllib | 6 | 2.91 MB | 25 Apr 2011 - 04:55 |
| FaceBook bot | 4+1 | 8.70 KB | 17 Apr 2011 - 06:25 |
| bender focused_crawler | 1+3 | 8.22 KB | 29 Apr 2011 - 01:41 |
| WGet tools | 4 | 2.20 MB | 18 Apr 2011 - 04:37 |
| YahooSeeker Yahoo! Blog crawler | 0+3 | 264 Bytes | 22 Apr 2011 - 00:47 |
| HTMLParser | 3 | 12.07 KB | 16 Apr 2011 - 11:56 |
| MSNBot-media | 2+1 | 10.79 KB | 28 Apr 2011 - 06:55 |
| legs | 1+2 | 4.19 KB | 13 Apr 2011 - 23:01 |
| larbin | 2+1 | 13.00 KB | 01 Apr 2011 - 00:47 |
| Powermarks | 1 | 4.02 KB | 19 Apr 2011 - 09:27 |
| Netcraft | 1 | 4.02 KB | 28 Apr 2011 - 07:27 |