33 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 7434+330 | 272.38 MB | 31 May 2011 - 23:02 |
Googlebot | 1668+58 | 90.58 MB | 31 May 2011 - 22:23 |
Yahoo Slurp | 739+62 | 37.89 MB | 31 May 2011 - 15:38 |
Java (Often spam bot) | 423 | 8.75 MB | 31 May 2011 - 14:11 |
Unknown robot (identified by empty user agent string) | 307+6 | 11.36 MB | 31 May 2011 - 23:25 |
Unknown robot (identified by 'bot*') | 135+168 | 873.43 KB | 31 May 2011 - 23:38 |
MSNBot | 155+22 | 660.12 KB | 31 May 2011 - 20:00 |
Nutch | 90+4 | 6.13 MB | 14 May 2011 - 21:41 |
BaiDuSpider | 80+7 | 273.64 KB | 31 May 2011 - 15:33 |
Harvest | 76 | 92.24 KB | 31 May 2011 - 23:23 |
Yandex bot | 35+19 | 516.45 KB | 31 May 2011 - 21:29 |
Jakarta commons-httpclient | 38 | 47.65 KB | 30 May 2011 - 00:06 |
Speedy Spider | 17+17 | 92.08 KB | 26 May 2011 - 23:17 |
Unknown robot (identified by 'robot') | 20+13 | 92.55 KB | 30 May 2011 - 15:08 |
Unknown robot (identified by 'discovery') | 11+19 | 15.42 KB | 29 May 2011 - 16:19 |
Voila | 20+10 | 39.76 KB | 31 May 2011 - 11:57 |
Unknown robot (identified by hit on 'robots.txt') | 0+25 | 2.15 KB | 27 May 2011 - 04:41 |
Custo | 13+12 | 53.68 KB | 29 May 2011 - 17:57 |
Unknown robot (identified by 'spider') | 11+7 | 36.79 KB | 31 May 2011 - 06:21 |
ichiro | 10+2 | 40.94 KB | 18 May 2011 - 04:05 |
Exabot | 6+5 | 13.92 KB | 30 May 2011 - 19:53 |
Perl tool | 10 | 18.10 KB | 25 May 2011 - 20:46 |
Unknown robot (identified by '*bot') | 3+3 | 10.50 KB | 31 May 2011 - 14:59 |
Sogou Spider | 6 | 19.85 KB | 29 May 2011 - 07:05 |
yacy | 3+1 | 47.31 KB | 28 May 2011 - 05:43 |
MJ12bot | 2+2 | 7.07 KB | 24 May 2011 - 20:35 |
MSNBot-media | 2+1 | 12.55 KB | 14 May 2011 - 04:53 |
GigaBot | 1+1 | 3.54 KB | 13 May 2011 - 00:10 |
HTTrack off-line browser | 1+1 | 3.50 KB | 30 May 2011 - 02:46 |
WGet tools | 2 | 170.94 KB | 16 May 2011 - 16:40 |
Netcraft | 2 | 6.90 KB | 28 May 2011 - 09:11 |
Alexa (IA Archiver) | 0+1 | 88 Bytes | 03 May 2011 - 16:05 |
bender focused_crawler | 0+1 | 88 Bytes | 15 May 2011 - 01:28 |