| 45 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 4520+61 | 708.54 MB | 28 Feb 2011 - 23:50 |
| Googlebot | 4612+52 | 932.19 MB | 28 Feb 2011 - 23:48 |
| OutfoxBot/YodaoBot | 20 | 80.45 KB | 28 Feb 2011 - 23:40 |
| Unknown robot (identified by 'bot*') | 2204+764 | 291.51 MB | 28 Feb 2011 - 23:32 |
| Sogou Spider | 32+3 | 1.24 MB | 28 Feb 2011 - 20:49 |
| Unknown robot (identified by empty user agent string) | 99+36 | 5.51 MB | 28 Feb 2011 - 20:49 |
| Unknown robot (identified by hit on 'robots.txt') | 0+44 | 3.78 KB | 28 Feb 2011 - 19:27 |
| Unknown robot (identified by 'crawl') | 23503+375 | 278.08 MB | 28 Feb 2011 - 18:35 |
| Unknown robot (identified by 'discovery') | 2100+57 | 135.86 MB | 28 Feb 2011 - 18:07 |
| Java (Often spam bot) | 144 | 3.18 MB | 28 Feb 2011 - 17:52 |
| Unknown robot (identified by 'robot') | 288+22 | 14.32 MB | 28 Feb 2011 - 17:39 |
| Harvest | 77 | 386.35 KB | 28 Feb 2011 - 16:53 |
| Voila | 118+45 | 9.47 MB | 28 Feb 2011 - 16:26 |
| Custo | 583+41 | 18.25 MB | 28 Feb 2011 - 15:36 |
| MJ12bot | 25+26 | 102.80 KB | 28 Feb 2011 - 14:58 |
| Exabot | 14+13 | 66.89 KB | 28 Feb 2011 - 14:44 |
| Findlinks | 121+3 | 981.17 KB | 28 Feb 2011 - 14:33 |
| MSNBot-media | 4+2 | 15.39 KB | 28 Feb 2011 - 08:28 |
| WGet tools | 7 | 3.70 MB | 28 Feb 2011 - 01:22 |
| Jakarta commons-httpclient | 46 | 6.79 MB | 28 Feb 2011 - 00:48 |
| Speedy Spider | 49+51 | 395.79 KB | 28 Feb 2011 - 00:24 |
| BaiDuSpider | 91+22 | 9.39 MB | 27 Feb 2011 - 20:33 |
| Unknown robot (identified by '*bot') | 13+16 | 48.99 KB | 27 Feb 2011 - 09:29 |
| Yandex bot | 257+33 | 14.28 MB | 27 Feb 2011 - 05:25 |
| Unknown robot (identified by 'spider') | 3+3 | 12.33 KB | 27 Feb 2011 - 03:40 |
| ichiro | 5+4 | 24.62 KB | 27 Feb 2011 - 03:03 |
| yacy | 9+2 | 1.23 MB | 26 Feb 2011 - 17:01 |
| Nutch | 350+31 | 14.28 MB | 24 Feb 2011 - 18:55 |
| Powermarks | 1 | 4.02 KB | 24 Feb 2011 - 16:03 |
| bender focused_crawler | 1+2 | 8.13 KB | 24 Feb 2011 - 02:12 |
| Perl tool | 8 | 16.79 KB | 23 Feb 2011 - 20:26 |
| Ask | 3+3 | 264 Bytes | 22 Feb 2011 - 21:02 |
| MSNBot | 130+3 | 6.52 MB | 21 Feb 2011 - 09:50 |
| EasyDL | 1 | 4.02 KB | 21 Feb 2011 - 08:41 |
| psbot | 2+2 | 18.90 KB | 21 Feb 2011 - 04:19 |
| YahooSeeker Yahoo! Blog crawler | 0+2 | 176 Bytes | 20 Feb 2011 - 23:04 |
| Spiderman | 380+7 | 23.50 MB | 19 Feb 2011 - 21:22 |
| The web archive (IA Archiver) | 0+2 | 176 Bytes | 18 Feb 2011 - 06:48 |
| larbin | 4+2 | 26.00 KB | 16 Feb 2011 - 18:23 |
| Alexa (IA Archiver) | 1+1 | 4.11 KB | 11 Feb 2011 - 17:31 |
| Python-urllib | 13 | 59.11 KB | 10 Feb 2011 - 20:58 |
| BSpider | 1 | 1.50 MB | 10 Feb 2011 - 20:50 |
| GigaBot | 1+1 | 4.11 KB | 09 Feb 2011 - 12:33 |
| DoCoMo | 16+2 | 127.80 KB | 03 Feb 2011 - 22:13 |
| CFNetwork | 1 | 147.61 KB | 02 Feb 2011 - 08:19 |