32 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 9577+406 | 15.61 MB | 31 Mar 2010 - 21:55 |
MSNBot | 882+539 | 8.05 MB | 31 Mar 2010 - 23:31 |
Yahoo Slurp | 561+60 | 5.03 MB | 31 Mar 2010 - 22:50 |
Googlebot | 312+31 | 1.73 MB | 31 Mar 2010 - 16:48 |
Harvest | 307 | 4.14 MB | 31 Mar 2010 - 09:55 |
Jakarta commons-httpclient | 248 | 1.67 MB | 31 Mar 2010 - 15:54 |
Java (Often spam bot) | 182 | 279.65 KB | 31 Mar 2010 - 23:19 |
BaiDuSpider | 85+18 | 258.62 KB | 31 Mar 2010 - 23:30 |
Speedy Spider | 44+41 | 173.79 KB | 31 Mar 2010 - 22:52 |
MSNBot-media | 45+31 | 209.70 KB | 31 Mar 2010 - 21:18 |
Heritrix | 59+2 | 1.55 MB | 15 Mar 2010 - 02:59 |
Yandex bot | 33+17 | 92.97 KB | 30 Mar 2010 - 18:27 |
Ask | 29+19 | 224.06 KB | 28 Mar 2010 - 20:10 |
Unknown robot (identified by hit on 'robots.txt') | 0+40 | 3.44 KB | 31 Mar 2010 - 21:24 |
twiceler | 8+26 | 27.76 KB | 31 Mar 2010 - 11:41 |
Unknown robot (identified by 'bot*') | 14+15 | 99.67 KB | 29 Mar 2010 - 07:01 |
GigaBot | 13+13 | 40.43 KB | 29 Mar 2010 - 18:02 |
Unknown robot (identified by empty user agent string) | 20+3 | 58.88 KB | 31 Mar 2010 - 15:46 |
Voila | 18+5 | 205.71 KB | 31 Mar 2010 - 04:53 |
Turn It In | 18+3 | 169.75 KB | 24 Mar 2010 - 03:50 |
Perl tool | 19 | 43.18 KB | 31 Mar 2010 - 19:14 |
larbin | 8+8 | 21.86 KB | 27 Mar 2010 - 00:49 |
Exabot | 6+6 | 29.83 KB | 28 Mar 2010 - 02:02 |
WGet tools | 10 | 486.73 KB | 29 Mar 2010 - 07:25 |
legs | 0+5 | 440 Bytes | 22 Mar 2010 - 03:56 |
Unknown robot (identified by 'discovery') | 2+2 | 6.73 KB | 25 Mar 2010 - 15:59 |
Unknown robot (identified by 'robot') | 1+2 | 3.20 KB | 16 Mar 2010 - 14:24 |
Alexa (IA Archiver) | 1+1 | 3.37 KB | 31 Mar 2010 - 12:46 |
yacy | 1+1 | 3.11 KB | 20 Mar 2010 - 02:27 |
Python-urllib | 2 | 3.96 KB | 22 Mar 2010 - 04:19 |
Netcraft | 2 | 6.05 KB | 11 Mar 2010 - 12:49 |
Unknown robot (identified by 'spider') | 0+1 | 88 Bytes | 18 Mar 2010 - 06:14 |