| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 16328+697 | 334.31 MB | 28 Feb 2009 - 23:59 |
| Yahoo Slurp | 3893+151 | 473.29 MB | 28 Feb 2009 - 23:43 |
| Unknown robot (identified by hit on 'robots.txt') | 0+823 | 70.73 KB | 28 Feb 2009 - 23:43 |
| Googlebot | 1691+42 | 719.91 MB | 28 Feb 2009 - 23:33 |
| MSNBot | 791+512 | 90.33 MB | 28 Feb 2009 - 23:00 |
| Unknown robot (identified by empty user agent string) | 44+19 | 14.73 MB | 28 Feb 2009 - 21:08 |
| Voila | 134+24 | 60.71 MB | 28 Feb 2009 - 20:49 |
| BaiDuSpider | 134+31 | 827.53 KB | 28 Feb 2009 - 19:04 |
| Custo | 435+49 | 34.68 MB | 28 Feb 2009 - 18:10 |
| Yandex bot | 470+12 | 115.75 MB | 28 Feb 2009 - 17:43 |
| Harvest | 480 | 1.14 MB | 28 Feb 2009 - 15:30 |
| larbin | 26+2 | 220.66 KB | 28 Feb 2009 - 15:04 |
| Unknown robot (identified by 'robot') | 42+13 | 914.36 KB | 28 Feb 2009 - 13:54 |
| twiceler | 8+7 | 26.02 KB | 28 Feb 2009 - 10:02 |
| Java (Often spam bot) | 195 | 1.09 MB | 28 Feb 2009 - 09:41 |
| Ask | 277+55 | 57.47 MB | 28 Feb 2009 - 02:30 |
| Unknown robot (identified by 'spider') | 3+4 | 4.17 KB | 27 Feb 2009 - 23:45 |
| Turn It In | 450+3 | 15.72 MB | 27 Feb 2009 - 22:58 |
| psbot | 2+2 | 18.50 KB | 27 Feb 2009 - 19:30 |
| MSNBot-media | 111+45 | 843.09 KB | 27 Feb 2009 - 18:39 |
| Unknown robot (identified by 'bot*') | 41+19 | 819.46 KB | 27 Feb 2009 - 05:53 |
| Mail.ru bot | 0+1 | 88 Bytes | 26 Feb 2009 - 23:34 |
| Nutch | 63+25 | 64.02 MB | 26 Feb 2009 - 22:07 |
| Exabot | 9+8 | 32.17 KB | 26 Feb 2009 - 21:09 |
| BSpider | 0+11 | 968 Bytes | 26 Feb 2009 - 00:11 |
| Jakarta commons-httpclient | 8+1 | 2.06 MB | 25 Feb 2009 - 20:16 |
| Speedy Spider | 26+17 | 147.09 KB | 25 Feb 2009 - 15:18 |
| Gaisbot | 7+2 | 25.16 KB | 25 Feb 2009 - 00:50 |
| GigaBot | 3+3 | 8.33 KB | 24 Feb 2009 - 19:25 |
| Alexa (IA Archiver) | 3+3 | 21.31 KB | 23 Feb 2009 - 23:32 |
| BBot | 0+1 | 88 Bytes | 23 Feb 2009 - 22:33 |
| Perl tool | 8 | 2.34 MB | 23 Feb 2009 - 17:14 |
| Steeler | 31+4 | 1.86 MB | 23 Feb 2009 - 06:56 |
| WGet tools | 24+3 | 3.78 MB | 23 Feb 2009 - 04:57 |
| YahooSeeker Yahoo! Blog crawler | 152+1 | 1.32 MB | 21 Feb 2009 - 03:30 |
| Ocelli | 876+2 | 272.90 MB | 19 Feb 2009 - 19:11 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 17 Feb 2009 - 07:20 |
| yacy | 1 | 3.82 KB | 14 Feb 2009 - 00:28 |
| Netcraft | 1 | 3.82 KB | 13 Feb 2009 - 16:39 |
| Robozilla | 1 | 3.82 KB | 13 Feb 2009 - 07:44 |
| MSIECrawler | 1 | 8.29 KB | 10 Feb 2009 - 17:49 |
| Heritrix | 1+1 | 3.91 KB | 10 Feb 2009 - 17:40 |
| Python-urllib | 1 | 3.82 KB | 01 Feb 2009 - 06:44 |