30 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 1264+372 | 7.63 MB | 31 Jan 2009 - 23:56 |
Ask | 30+12 | 362.39 KB | 31 Jan 2009 - 23:18 |
Yahoo Slurp | 663+121 | 5.07 MB | 31 Jan 2009 - 23:11 |
BaiDuSpider | 109 | 430.57 KB | 31 Jan 2009 - 22:06 |
MSNBot-media | 41+30 | 182.56 KB | 31 Jan 2009 - 21:31 |
MSNBot | 143+128 | 1.52 MB | 31 Jan 2009 - 21:11 |
Harvest | 286 | 660.95 KB | 31 Jan 2009 - 16:30 |
Googlebot | 949+30 | 20.86 MB | 31 Jan 2009 - 15:43 |
BSpider | 1+24 | 5.32 KB | 31 Jan 2009 - 15:29 |
Custo | 13+11 | 41.18 KB | 31 Jan 2009 - 13:08 |
twiceler | 63+11 | 373.13 KB | 31 Jan 2009 - 12:19 |
Speedy Spider | 13+10 | 56.43 KB | 31 Jan 2009 - 10:12 |
Exabot | 53+13 | 200.86 KB | 31 Jan 2009 - 05:17 |
Nutch | 53+37 | 208.14 KB | 30 Jan 2009 - 23:17 |
Unknown robot (identified by hit on 'robots.txt') | 0+70 | 4.81 KB | 30 Jan 2009 - 21:32 |
Voila | 16+8 | 35.85 KB | 30 Jan 2009 - 19:25 |
Jakarta commons-httpclient | 2 | 898 Bytes | 29 Jan 2009 - 17:45 |
GigaBot | 3+4 | 9.28 KB | 28 Jan 2009 - 17:26 |
Unknown robot (identified by empty user agent string) | 5+12 | 54.88 KB | 28 Jan 2009 - 13:52 |
Unknown robot (identified by 'bot*') | 10+6 | 51.20 KB | 28 Jan 2009 - 10:59 |
Java (Often spam bot) | 459 | 855.21 KB | 27 Jan 2009 - 18:26 |
Steeler | 12+4 | 52.95 KB | 24 Jan 2009 - 16:13 |
yacy | 3+2 | 10.69 KB | 23 Jan 2009 - 19:11 |
WGet tools | 2 | 86.25 KB | 23 Jan 2009 - 15:46 |
Yandex bot | 1+1 | 3.34 KB | 19 Jan 2009 - 22:09 |
Sogou Spider | 1 | 0 | 16 Jan 2009 - 07:05 |
MSIECrawler | 0+1 | 88 Bytes | 08 Jan 2009 - 23:59 |
Netcraft | 1 | 3.25 KB | 06 Jan 2009 - 12:19 |
Perl tool | 1 | 3.41 KB | 02 Jan 2009 - 13:53 |
BecomeBot | 1+1 | 3.34 KB | 02 Jan 2009 - 10:44 |