| 38 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 15115+384 | 73.13 MB | 31 Jan 2010 - 22:17 |
| Googlebot | 3778+54 | 364.31 MB | 31 Jan 2010 - 23:59 |
| MSNBot | 2433+916 | 63.30 MB | 31 Jan 2010 - 23:42 |
| Yahoo Slurp | 2952+69 | 583.31 MB | 31 Jan 2010 - 23:56 |
| Python-urllib | 903 | 7.90 MB | 23 Jan 2010 - 04:08 |
| Custo | 474+57 | 23.40 MB | 31 Jan 2010 - 12:38 |
| Unknown robot (identified by 'bot*') | 371+102 | 10.72 MB | 31 Jan 2010 - 15:07 |
| Ocelli | 458+1 | 250.50 MB | 18 Jan 2010 - 16:39 |
| Java (Often spam bot) | 360 | 1.49 MB | 31 Jan 2010 - 18:26 |
| Yandex bot | 303+49 | 1.98 MB | 31 Jan 2010 - 23:30 |
| Ask | 253+70 | 41.96 MB | 31 Jan 2010 - 23:59 |
| Unknown robot (identified by empty user agent string) | 205+13 | 4.80 MB | 31 Jan 2010 - 12:34 |
| Voila | 148+58 | 1.21 MB | 29 Jan 2010 - 05:43 |
| Harvest | 171 | 765.23 KB | 31 Jan 2010 - 17:46 |
| Speedy Spider | 93+73 | 618.69 KB | 31 Jan 2010 - 16:25 |
| BaiDuSpider | 72+32 | 1.22 MB | 31 Jan 2010 - 16:42 |
| MSNBot-media | 68+32 | 242.55 KB | 31 Jan 2010 - 06:35 |
| twiceler | 40+47 | 1.04 MB | 31 Jan 2010 - 07:27 |
| Jakarta commons-httpclient | 69 | 744.43 KB | 31 Jan 2010 - 11:58 |
| Exabot | 40+23 | 6.64 MB | 31 Jan 2010 - 15:30 |
| Unknown robot (identified by hit on 'robots.txt') | 0+58 | 4.98 KB | 31 Jan 2010 - 21:38 |
| Turn It In | 51+2 | 4.83 MB | 31 Jan 2010 - 23:57 |
| Unknown robot (identified by 'discovery') | 25+19 | 186.37 KB | 24 Jan 2010 - 10:17 |
| Unknown robot (identified by 'robot') | 23+21 | 6.20 MB | 31 Jan 2010 - 23:39 |
| Alexa (IA Archiver) | 15+6 | 166.99 KB | 28 Jan 2010 - 01:51 |
| Nutch | 9+9 | 1.29 MB | 30 Jan 2010 - 17:33 |
| Unknown robot (identified by 'spider') | 6+6 | 15.80 KB | 30 Jan 2010 - 23:52 |
| Spiderman | 4+4 | 15.63 KB | 28 Jan 2010 - 10:45 |
| Voyager | 2+5 | 2.78 KB | 23 Jan 2010 - 10:27 |
| HTMLParser | 6 | 34.00 KB | 02 Jan 2010 - 12:18 |
| larbin | 3+2 | 16.51 KB | 21 Jan 2010 - 23:01 |
| WGet tools | 3 | 1.57 MB | 27 Jan 2010 - 11:14 |
| Heritrix | 2+1 | 7.22 KB | 15 Jan 2010 - 21:46 |
| Perl tool | 2 | 4.00 KB | 14 Jan 2010 - 08:35 |
| Findlinks | 1 | 3.82 KB | 11 Jan 2010 - 08:39 |
| HTTrack off-line browser | 1 | 0 | 24 Jan 2010 - 18:49 |
| Unknown robot (identified by 'checker') | 1 | 3.82 KB | 13 Jan 2010 - 14:59 |
| Netcraft | 1 | 3.82 KB | 13 Jan 2010 - 16:46 |