32 different robots | Hits | Bandwidth | Last visit |
BaiDuSpider | 10029 | 769.72 MB | 31 Mar 2015 - 23:58 |
Unknown robot (identified by 'crawl') | 8019+20 | 263.67 MB | 31 Mar 2015 - 11:04 |
Unknown robot (identified by 'bot*') | 3754+725 | 1.07 GB | 31 Mar 2015 - 23:21 |
Yahoo Slurp | 4323+32 | 316.90 MB | 31 Mar 2015 - 23:41 |
Googlebot | 2998+468 | 658.19 MB | 31 Mar 2015 - 23:26 |
Yandex bot | 700+59 | 202.67 MB | 31 Mar 2015 - 22:16 |
Unknown robot (identified by empty user agent string) | 318+11 | 12.68 MB | 31 Mar 2015 - 23:41 |
yacy | 245+11 | 27.56 MB | 30 Mar 2015 - 13:15 |
Sogou Spider | 117+30 | 5.98 MB | 31 Mar 2015 - 16:13 |
Unknown robot (identified by hit on 'robots.txt') | 0+107 | 9.51 KB | 31 Mar 2015 - 23:40 |
MJ12bot | 29+28 | 455.12 KB | 31 Mar 2015 - 02:30 |
Harvest | 55 | 81.77 KB | 27 Mar 2015 - 16:42 |
Jakarta commons-httpclient | 52 | 118.02 KB | 26 Mar 2015 - 10:15 |
Java (Often spam bot) | 41 | 33.15 MB | 30 Mar 2015 - 03:28 |
Heritrix | 35+1 | 1.12 MB | 07 Mar 2015 - 19:25 |
Feedfetcher-Google | 31 | 1.40 MB | 31 Mar 2015 - 16:41 |
Python-urllib | 24+2 | 219.85 KB | 30 Mar 2015 - 02:17 |
Nutch | 9+14 | 70.36 KB | 28 Mar 2015 - 01:19 |
Exabot | 13+8 | 149.22 KB | 30 Mar 2015 - 23:57 |
FaceBook bot | 13 | 769.02 KB | 21 Mar 2015 - 16:49 |
Unknown robot (identified by 'spider') | 3+8 | 46.96 KB | 27 Mar 2015 - 19:16 |
Unknown robot (identified by 'robot') | 6+5 | 152.81 KB | 24 Mar 2015 - 09:08 |
FavIconizer | 10 | 78.16 KB | 31 Mar 2015 - 22:06 |
Alexa (IA Archiver) | 3+4 | 46.41 KB | 24 Mar 2015 - 00:32 |
MSNBot-media | 5 | 323.85 KB | 31 Mar 2015 - 12:56 |
Perl tool | 5 | 4.31 MB | 18 Mar 2015 - 08:36 |
WGet tools | 3 | 7.57 MB | 17 Mar 2015 - 18:51 |
ExactSeek Crawler | 1+1 | 7.91 KB | 14 Mar 2015 - 06:23 |
WordPress | 2 | 0 | 02 Mar 2015 - 18:37 |
archive.org bot | 0+2 | 182 Bytes | 31 Mar 2015 - 19:27 |
Netcraft | 2 | 7.82 KB | 05 Mar 2015 - 15:43 |
HTTrack off-line browser | 1 | 142.26 KB | 24 Mar 2015 - 17:50 |