| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| MSNBot | 3237+1149 | 499.66 MB | 31 Aug 2009 - 23:53 |
| Ask | 263+52 | 90.35 MB | 31 Aug 2009 - 23:49 |
| Yandex bot | 909+34 | 392.83 MB | 31 Aug 2009 - 23:46 |
| Googlebot | 1650+47 | 809.79 MB | 31 Aug 2009 - 23:40 |
| Yahoo Slurp | 2792+118 | 555.98 MB | 31 Aug 2009 - 23:39 |
| Voila | 143+29 | 117.52 MB | 31 Aug 2009 - 23:38 |
| Unknown robot (identified by hit on 'robots.txt') | 0+120 | 10.31 KB | 31 Aug 2009 - 22:25 |
| Unknown robot (identified by 'crawl') | 16424+443 | 131.12 MB | 31 Aug 2009 - 22:23 |
| BaiDuSpider | 127+50 | 786.30 KB | 31 Aug 2009 - 19:39 |
| twiceler | 51+30 | 354.06 KB | 31 Aug 2009 - 19:18 |
| Unknown robot (identified by 'spider') | 6+6 | 327.72 KB | 31 Aug 2009 - 19:04 |
| Harvest | 364 | 534.95 KB | 31 Aug 2009 - 17:30 |
| Speedy Spider | 29+18 | 784.87 KB | 31 Aug 2009 - 16:29 |
| Unknown robot (identified by 'bot*') | 51+40 | 200.88 KB | 31 Aug 2009 - 15:15 |
| GigaBot | 24+21 | 93.52 KB | 31 Aug 2009 - 14:36 |
| Custo | 382+53 | 41.53 MB | 31 Aug 2009 - 13:04 |
| WGet tools | 3 | 485.54 KB | 31 Aug 2009 - 10:55 |
| Yahoo-MMCrawler | 3+1 | 9.43 KB | 31 Aug 2009 - 04:58 |
| Heritrix | 5+6 | 19.62 KB | 31 Aug 2009 - 03:29 |
| Exabot | 31+22 | 123.93 KB | 30 Aug 2009 - 21:15 |
| Unknown robot (identified by empty user agent string) | 38+21 | 1.46 MB | 30 Aug 2009 - 18:44 |
| Jakarta commons-httpclient | 5 | 1.42 MB | 29 Aug 2009 - 16:39 |
| psbot | 3+3 | 21.29 KB | 29 Aug 2009 - 04:58 |
| Alexa (IA Archiver) | 9+8 | 48.47 KB | 28 Aug 2009 - 17:31 |
| larbin | 9+9 | 38.16 KB | 28 Aug 2009 - 14:52 |
| Ocelli | 874+2 | 271.52 MB | 28 Aug 2009 - 09:02 |
| Python-urllib | 26+1 | 3.60 MB | 28 Aug 2009 - 07:24 |
| Unknown robot (identified by 'robot') | 6+5 | 3.19 MB | 28 Aug 2009 - 05:12 |
| Nutch | 101+27 | 854.84 KB | 26 Aug 2009 - 09:00 |
| Unknown robot (identified by 'hunter') | 3 | 25.25 KB | 26 Aug 2009 - 05:42 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 25 Aug 2009 - 11:54 |
| CFNetwork | 1 | 353.18 KB | 25 Aug 2009 - 02:26 |
| Findlinks | 1+1 | 3.91 KB | 23 Aug 2009 - 21:08 |
| Java (Often spam bot) | 43 | 194.94 KB | 23 Aug 2009 - 14:35 |
| Gaisbot | 1+1 | 3.40 KB | 19 Aug 2009 - 14:33 |
| Perl tool | 2 | 7.64 KB | 19 Aug 2009 - 05:31 |
| Sogou Spider | 7 | 10.67 MB | 18 Aug 2009 - 03:35 |
| Mail.ru bot | 14+5 | 79.76 KB | 17 Aug 2009 - 20:33 |
| Turn It In | 33+2 | 11.32 MB | 15 Aug 2009 - 10:22 |
| Powermarks | 1 | 3.82 KB | 15 Aug 2009 - 00:24 |
| Spiderman | 1+1 | 3.91 KB | 12 Aug 2009 - 20:07 |
| Netcraft | 1 | 3.82 KB | 06 Aug 2009 - 10:25 |