| 49 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 4217+82 | 754.68 MB | 31 May 2011 - 23:53 |
| Ask | 6+6 | 4.54 KB | 31 May 2011 - 23:51 |
| Unknown robot (identified by 'crawl') | 23457+469 | 594.67 MB | 31 May 2011 - 23:39 |
| Unknown robot (identified by empty user agent string) | 660+59 | 80.44 MB | 31 May 2011 - 23:30 |
| Voila | 127+48 | 10.31 MB | 31 May 2011 - 22:24 |
| BaiDuSpider | 110+37 | 2.85 MB | 31 May 2011 - 21:33 |
| Java (Often spam bot) | 211 | 2.89 MB | 31 May 2011 - 20:42 |
| MSNBot | 155+22 | 681.30 KB | 31 May 2011 - 20:23 |
| Unknown robot (identified by 'bot*') | 2137+505 | 209.11 MB | 31 May 2011 - 19:00 |
| Unknown robot (identified by '*bot') | 10+113 | 38.49 KB | 31 May 2011 - 18:35 |
| Googlebot | 3804+53 | 539.35 MB | 31 May 2011 - 18:26 |
| Harvest | 82 | 134.92 KB | 31 May 2011 - 18:20 |
| Custo | 729+51 | 23.01 MB | 31 May 2011 - 18:00 |
| Yandex bot | 181+36 | 28.44 MB | 31 May 2011 - 15:13 |
| Findlinks | 27+17 | 271.00 KB | 31 May 2011 - 13:47 |
| Nutch | 126+20 | 7.38 MB | 31 May 2011 - 13:37 |
| Unknown robot (identified by 'spider') | 26+3 | 96.94 KB | 31 May 2011 - 06:13 |
| DoCoMo | 18+2 | 104.45 KB | 31 May 2011 - 01:34 |
| MJ12bot | 98+55 | 488.89 KB | 30 May 2011 - 23:56 |
| Speedy Spider | 63+57 | 499.20 KB | 30 May 2011 - 18:07 |
| Unknown robot (identified by 'robot') | 924+15 | 50.31 MB | 30 May 2011 - 15:30 |
| InternetSeer | 3 | 5.52 KB | 30 May 2011 - 03:56 |
| HTTrack off-line browser | 1+1 | 3.40 KB | 30 May 2011 - 02:48 |
| Jakarta commons-httpclient | 39 | 9.27 MB | 30 May 2011 - 00:07 |
| Sogou Spider | 66+8 | 7.20 MB | 29 May 2011 - 22:12 |
| Unknown robot (identified by 'discovery') | 166+249 | 3.71 MB | 29 May 2011 - 16:58 |
| Exabot | 22+17 | 178.95 KB | 29 May 2011 - 04:40 |
| Perl tool | 13 | 311.09 KB | 28 May 2011 - 22:41 |
| BSpider | 0+5 | 440 Bytes | 27 May 2011 - 20:33 |
| Unknown robot (identified by hit on 'robots.txt') | 0+58 | 4.98 KB | 27 May 2011 - 04:07 |
| bender focused_crawler | 2+6 | 18.29 KB | 25 May 2011 - 01:16 |
| Alexa (IA Archiver) | 73+5 | 4.40 MB | 23 May 2011 - 15:25 |
| Fish search | 1 | 7.52 KB | 22 May 2011 - 21:03 |
| Motor | 1 | 414.78 KB | 22 May 2011 - 17:57 |
| YahooSeeker Yahoo! Blog crawler | 0+3 | 264 Bytes | 22 May 2011 - 01:02 |
| WordPress | 6 | 0 | 21 May 2011 - 05:36 |
| yacy | 4 | 533.87 KB | 18 May 2011 - 14:41 |
| ichiro | 34+6 | 196.47 KB | 18 May 2011 - 12:06 |
| WGet tools | 19 | 28.57 MB | 16 May 2011 - 16:31 |
| Python-urllib | 1 | 2.19 MB | 15 May 2011 - 09:28 |
| Checkbot | 1 | 0 | 14 May 2011 - 19:06 |
| FavIconizer | 1 | 4.02 KB | 10 May 2011 - 11:51 |
| CFNetwork | 2 | 2.11 MB | 09 May 2011 - 18:42 |
| psbot | 2+2 | 18.90 KB | 09 May 2011 - 14:37 |
| The web archive (IA Archiver) | 0+3 | 264 Bytes | 09 May 2011 - 13:52 |
| larbin | 2+1 | 13.00 KB | 08 May 2011 - 22:35 |
| Netcraft | 2 | 8.04 KB | 06 May 2011 - 11:55 |
| Unknown robot (identified by 'checker') | 1 | 4.02 KB | 05 May 2011 - 02:56 |
| Unknown robot (identified by 'hunter') | 1 | 5.55 KB | 03 May 2011 - 03:59 |