43 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 54059+625 | 111.01 MB | 30 Apr 2010 - 22:59 |
Googlebot | 4412+55 | 404.37 MB | 30 Apr 2010 - 23:54 |
MSNBot | 2004+626 | 317.43 MB | 30 Apr 2010 - 23:58 |
Yahoo Slurp | 2480+63 | 570.18 MB | 30 Apr 2010 - 23:11 |
Unknown robot (identified by 'bot*') | 631+60 | 3.71 MB | 30 Apr 2010 - 21:54 |
Custo | 478+44 | 17.46 MB | 30 Apr 2010 - 14:09 |
Voila | 188+66 | 9.40 MB | 30 Apr 2010 - 23:40 |
Turn It In | 147+8 | 21.89 MB | 29 Apr 2010 - 11:16 |
Ask | 101+52 | 40.19 MB | 30 Apr 2010 - 16:58 |
Speedy Spider | 84+68 | 2.52 MB | 29 Apr 2010 - 23:29 |
Yandex bot | 98+44 | 529.38 KB | 30 Apr 2010 - 04:09 |
twiceler | 81+57 | 2.66 MB | 30 Apr 2010 - 05:04 |
MSNBot-media | 94+41 | 413.98 KB | 30 Apr 2010 - 02:02 |
Mail.ru bot | 123+3 | 984.17 KB | 30 Apr 2010 - 11:08 |
BaiDuSpider | 59+53 | 769.78 KB | 30 Apr 2010 - 16:49 |
Nutch | 53+40 | 246.84 KB | 30 Apr 2010 - 17:42 |
psbot | 87+2 | 524.67 KB | 29 Apr 2010 - 16:12 |
Harvest | 82 | 1.42 MB | 30 Apr 2010 - 02:30 |
Java (Often spam bot) | 74+2 | 241.42 KB | 26 Apr 2010 - 17:35 |
Unknown robot (identified by empty user agent string) | 62+12 | 1.09 MB | 30 Apr 2010 - 22:48 |
Jakarta commons-httpclient | 64 | 5.97 MB | 30 Apr 2010 - 01:21 |
Unknown robot (identified by hit on 'robots.txt') | 0+46 | 3.95 KB | 30 Apr 2010 - 23:43 |
Exabot | 24+15 | 111.77 KB | 29 Apr 2010 - 13:22 |
MJ12bot | 22+1 | 168.46 KB | 14 Apr 2010 - 21:51 |
Unknown robot (identified by 'spider') | 11+11 | 2.03 MB | 30 Apr 2010 - 05:00 |
GigaBot | 11+11 | 42.98 KB | 29 Apr 2010 - 10:58 |
Perl tool | 21 | 843.53 KB | 28 Apr 2010 - 20:02 |
Spiderman | 15+5 | 54.22 KB | 29 Apr 2010 - 04:47 |
legs | 13+7 | 53.46 KB | 19 Apr 2010 - 01:35 |
WGet tools | 10 | 4.31 MB | 29 Apr 2010 - 21:35 |
Unknown robot (identified by 'robot') | 5+5 | 554.83 KB | 24 Apr 2010 - 00:45 |
Alexa (IA Archiver) | 3+3 | 212.99 KB | 28 Apr 2010 - 17:01 |
yacy | 5+1 | 1.23 MB | 30 Apr 2010 - 08:06 |
EasyDL | 4 | 17.64 KB | 30 Apr 2010 - 17:49 |
Findlinks | 3 | 29.69 KB | 02 Apr 2010 - 10:29 |
lwp-request | 3 | 3.82 KB | 09 Apr 2010 - 11:56 |
CFNetwork | 2 | 512.57 KB | 13 Apr 2010 - 08:53 |
Web Core / Roots | 1+1 | 3.91 KB | 22 Apr 2010 - 06:43 |
BBot | 2 | 984.33 KB | 18 Apr 2010 - 23:32 |
The web archive (IA Archiver) | 0+1 | 88 Bytes | 08 Apr 2010 - 12:51 |
Gaisbot | 1 | 5.32 KB | 17 Apr 2010 - 17:57 |
Python-urllib | 0+1 | 88 Bytes | 09 Apr 2010 - 01:50 |
Netcraft | 1 | 3.82 KB | 08 Apr 2010 - 20:14 |