42 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 19088+195 | 288.42 MB | 30 Apr 2011 - 23:57 |
Googlebot | 4729+59 | 694.30 MB | 30 Apr 2011 - 23:52 |
ichiro | 104+10 | 493.09 KB | 30 Apr 2011 - 23:49 |
Yahoo Slurp | 4098+83 | 753.88 MB | 30 Apr 2011 - 23:35 |
BaiDuSpider | 247+37 | 2.68 MB | 30 Apr 2011 - 22:30 |
Unknown robot (identified by 'bot*') | 1046+654 | 178.17 MB | 30 Apr 2011 - 21:32 |
MJ12bot | 192+44 | 934.67 KB | 30 Apr 2011 - 21:25 |
Exabot | 20+10 | 113.33 KB | 30 Apr 2011 - 21:11 |
Unknown robot (identified by empty user agent string) | 1951+60 | 27.32 MB | 30 Apr 2011 - 20:05 |
Unknown robot (identified by 'spider') | 98+6 | 3.58 MB | 30 Apr 2011 - 18:40 |
Harvest | 91 | 414.21 KB | 30 Apr 2011 - 17:59 |
BSpider | 0+6 | 528 Bytes | 30 Apr 2011 - 17:16 |
Custo | 675+51 | 28.81 MB | 30 Apr 2011 - 17:06 |
Voila | 101+38 | 8.75 MB | 30 Apr 2011 - 17:03 |
Unknown robot (identified by hit on 'robots.txt') | 0+90 | 7.73 KB | 30 Apr 2011 - 16:44 |
Yandex bot | 638+52 | 58.18 MB | 30 Apr 2011 - 16:25 |
Speedy Spider | 54+53 | 1.80 MB | 30 Apr 2011 - 12:28 |
Unknown robot (identified by 'robot') | 977+15 | 27.64 MB | 30 Apr 2011 - 10:13 |
Findlinks | 20+10 | 282.34 KB | 30 Apr 2011 - 04:37 |
Unknown robot (identified by 'discovery') | 1349+1407 | 107.45 MB | 30 Apr 2011 - 03:13 |
Nutch | 27+16 | 229.54 KB | 29 Apr 2011 - 23:08 |
Sogou Spider | 64+6 | 6.46 MB | 29 Apr 2011 - 22:58 |
bender focused_crawler | 1+3 | 8.22 KB | 29 Apr 2011 - 01:41 |
Java (Often spam bot) | 200 | 1.51 MB | 28 Apr 2011 - 18:49 |
Unknown robot (identified by '*bot') | 16+19 | 59.66 KB | 28 Apr 2011 - 11:17 |
Netcraft | 1 | 4.02 KB | 28 Apr 2011 - 07:27 |
MSNBot-media | 2+1 | 10.79 KB | 28 Apr 2011 - 06:55 |
Jakarta commons-httpclient | 41 | 6.25 MB | 28 Apr 2011 - 00:44 |
MSNBot | 153+19 | 672.04 KB | 27 Apr 2011 - 23:00 |
Alexa (IA Archiver) | 15+5 | 71.24 KB | 26 Apr 2011 - 15:36 |
Perl tool | 10 | 27.75 KB | 26 Apr 2011 - 03:41 |
Python-urllib | 6 | 2.91 MB | 25 Apr 2011 - 04:55 |
Ocelli | 536+1 | 256.84 MB | 24 Apr 2011 - 20:19 |
YahooSeeker Yahoo! Blog crawler | 0+3 | 264 Bytes | 22 Apr 2011 - 00:47 |
Heritrix | 536+3 | 256.87 MB | 20 Apr 2011 - 23:20 |
Powermarks | 1 | 4.02 KB | 19 Apr 2011 - 09:27 |
WGet tools | 4 | 2.20 MB | 18 Apr 2011 - 04:37 |
FaceBook bot | 4+1 | 8.70 KB | 17 Apr 2011 - 06:25 |
HTMLParser | 3 | 12.07 KB | 16 Apr 2011 - 11:56 |
legs | 1+2 | 4.19 KB | 13 Apr 2011 - 23:01 |
Steeler | 14+1 | 407.52 KB | 11 Apr 2011 - 09:57 |
larbin | 2+1 | 13.00 KB | 01 Apr 2011 - 00:47 |