32 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 15961+657 | 399.19 MB | 31 Jul 2010 - 22:38 |
Googlebot | 2592+56 | 68.76 MB | 31 Jul 2010 - 23:05 |
Yahoo Slurp | 925+61 | 39.24 MB | 31 Jul 2010 - 22:08 |
MSNBot | 118+169 | 832.72 KB | 31 Jul 2010 - 23:36 |
archive.org bot | 167+1 | 14.85 MB | 03 Jul 2010 - 06:21 |
Jakarta commons-httpclient | 134+1 | 1.98 MB | 31 Jul 2010 - 09:31 |
Unknown robot (identified by 'bot*') | 53+34 | 1.58 MB | 31 Jul 2010 - 23:21 |
Harvest | 75 | 131.34 KB | 31 Jul 2010 - 07:28 |
Unknown robot (identified by 'discovery') | 32+32 | 262.09 KB | 15 Jul 2010 - 09:59 |
MSNBot-media | 38+24 | 163.85 KB | 31 Jul 2010 - 06:01 |
BaiDuSpider | 27+31 | 277.00 KB | 31 Jul 2010 - 04:43 |
Unknown robot (identified by 'robot') | 35+4 | 121.13 KB | 21 Jul 2010 - 18:34 |
Yandex bot | 23+14 | 156.89 KB | 29 Jul 2010 - 11:00 |
Ask | 18+15 | 1.33 MB | 25 Jul 2010 - 06:51 |
Unknown robot (identified by empty user agent string) | 24+7 | 74.13 KB | 31 Jul 2010 - 09:25 |
Java (Often spam bot) | 31 | 20.13 KB | 31 Jul 2010 - 02:04 |
Unknown robot (identified by hit on 'robots.txt') | 0+31 | 2.66 KB | 28 Jul 2010 - 01:28 |
twiceler | 0+30 | 2.58 KB | 30 Jul 2010 - 02:41 |
Speedy Spider | 13+11 | 76.67 KB | 28 Jul 2010 - 05:20 |
Voila | 14+8 | 27.92 KB | 30 Jul 2010 - 19:05 |
Custo | 11+8 | 32.20 KB | 29 Jul 2010 - 22:04 |
Alexa (IA Archiver) | 14+2 | 135.05 KB | 04 Jul 2010 - 10:02 |
Unknown robot (identified by 'spider') | 8+2 | 33.41 KB | 10 Jul 2010 - 16:52 |
Exabot | 2+2 | 9.50 KB | 23 Jul 2010 - 06:59 |
Perl tool | 4 | 7.24 KB | 14 Jul 2010 - 19:59 |
yacy | 3+1 | 47.31 KB | 22 Jul 2010 - 01:28 |
WGet tools | 4 | 172.50 KB | 13 Jul 2010 - 20:24 |
MJ12bot | 2+2 | 7.07 KB | 25 Jul 2010 - 11:24 |
larbin | 1+1 | 3.54 KB | 12 Jul 2010 - 06:06 |
Python-urllib | 1 | 3.41 KB | 01 Jul 2010 - 15:02 |
Sogou Spider | 1 | 3.45 KB | 21 Jul 2010 - 11:27 |
Netcraft | 1 | 3.45 KB | 10 Jul 2010 - 03:55 |