26 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 11509+537 | 299.77 MB | 31 Aug 2010 - 20:34 |
Googlebot | 2614+51 | 97.79 MB | 31 Aug 2010 - 21:54 |
Yahoo Slurp | 899+62 | 42.06 MB | 31 Aug 2010 - 23:32 |
MSNBot | 96+174 | 4.82 MB | 31 Aug 2010 - 12:28 |
Heritrix | 159+1 | 14.99 MB | 14 Aug 2010 - 18:13 |
BaiDuSpider | 83+30 | 292.11 KB | 31 Aug 2010 - 18:29 |
Unknown robot (identified by 'bot*') | 61+37 | 17.35 KB | 26 Aug 2010 - 06:05 |
Ask | 62+31 | 6.37 MB | 31 Aug 2010 - 19:39 |
MSNBot-media | 45+29 | 196.05 KB | 31 Aug 2010 - 16:36 |
Harvest | 51 | 79.17 KB | 31 Aug 2010 - 21:53 |
Speedy Spider | 16+16 | 85.66 KB | 31 Aug 2010 - 10:01 |
Java (Often spam bot) | 30 | 18.73 KB | 30 Aug 2010 - 21:46 |
Voila | 17+9 | 35.34 KB | 30 Aug 2010 - 17:19 |
Unknown robot (identified by hit on 'robots.txt') | 0+24 | 2.06 KB | 30 Aug 2010 - 16:23 |
Custo | 13+11 | 45.73 KB | 29 Aug 2010 - 21:02 |
Yandex bot | 15+9 | 72.44 KB | 26 Aug 2010 - 20:48 |
Exabot | 10+9 | 19.62 KB | 25 Aug 2010 - 03:41 |
Jakarta commons-httpclient | 18 | 22.57 KB | 26 Aug 2010 - 06:30 |
Unknown robot (identified by empty user agent string) | 8+4 | 24.40 KB | 30 Aug 2010 - 02:09 |
Perl tool | 8 | 14.48 KB | 25 Aug 2010 - 20:01 |
yacy | 3+1 | 47.27 KB | 31 Aug 2010 - 05:36 |
Unknown robot (identified by 'robot') | 2+2 | 7.07 KB | 19 Aug 2010 - 09:20 |
HTTrack off-line browser | 2 | 6.83 KB | 03 Aug 2010 - 16:37 |
WGet tools | 1 | 43.12 KB | 28 Aug 2010 - 01:15 |
Sogou Spider | 1 | 3.45 KB | 12 Aug 2010 - 02:40 |
Netcraft | 1 | 3.45 KB | 10 Aug 2010 - 20:26 |