36 different robots | Hits | Bandwidth | Last visit |
Googlebot | 3034+452 | 2.17 GB | 30 Sep 2017 - 23:56 |
Yahoo Slurp | 633+36 | 44.93 MB | 30 Sep 2017 - 23:55 |
Unknown robot (identified by 'bot*') | 21124+476 | 2.85 GB | 30 Sep 2017 - 23:54 |
BaiDuSpider | 791 | 105.64 MB | 30 Sep 2017 - 23:46 |
Unknown robot (identified by 'spider') | 49 | 2.97 MB | 30 Sep 2017 - 23:27 |
Unknown robot (identified by '*bot') | 646+9 | 5.42 MB | 30 Sep 2017 - 23:13 |
Java (Often spam bot) | 431 | 3.92 MB | 30 Sep 2017 - 20:46 |
Unknown robot (identified by empty user agent string) | 295+2 | 55.94 MB | 30 Sep 2017 - 19:48 |
Yandex bot | 733+234 | 62.88 MB | 30 Sep 2017 - 17:28 |
Unknown robot (identified by hit on 'robots.txt') | 0+171 | 15.20 KB | 30 Sep 2017 - 10:35 |
Python-urllib | 41 | 9.57 MB | 30 Sep 2017 - 10:25 |
Feedfetcher-Google | 120 | 1.91 MB | 30 Sep 2017 - 05:01 |
MJ12bot | 31+31 | 316.67 KB | 30 Sep 2017 - 02:34 |
Harvest | 26 | 1.84 MB | 30 Sep 2017 - 01:21 |
FavIconizer | 15 | 120.47 KB | 29 Sep 2017 - 16:03 |
Sogou Spider | 206+73 | 15.52 MB | 29 Sep 2017 - 07:30 |
Unknown robot (identified by 'checker') | 5+1 | 227.71 KB | 29 Sep 2017 - 06:13 |
Perl tool | 6 | 25.07 KB | 28 Sep 2017 - 22:33 |
yacy | 9+12 | 235.45 KB | 28 Sep 2017 - 18:20 |
WGet tools | 12 | 96.38 KB | 28 Sep 2017 - 16:11 |
Unknown robot (identified by 'robot') | 12+4 | 100.83 KB | 28 Sep 2017 - 14:43 |
Nutch | 26+11 | 532.81 KB | 28 Sep 2017 - 01:37 |
Web Core / Roots | 262 | 5.11 MB | 27 Sep 2017 - 06:49 |
Exabot | 6+3 | 68.78 KB | 27 Sep 2017 - 03:42 |
Unknown robot (identified by 'crawl') | 13646+90 | 588.46 MB | 26 Sep 2017 - 22:45 |
archive.org bot | 24+37 | 8.45 MB | 26 Sep 2017 - 10:50 |
UniversalFeedParser | 5 | 30.50 KB | 26 Sep 2017 - 08:18 |
FaceBook bot | 1 | 24.15 KB | 25 Sep 2017 - 05:59 |
Turn It In | 193+6 | 373.21 MB | 23 Sep 2017 - 15:30 |
Alexa (IA Archiver) | 10+11 | 246.01 KB | 19 Sep 2017 - 16:46 |
SeznamBot | 1+1 | 8.12 KB | 14 Sep 2017 - 15:07 |
psbot | 2+1 | 81.10 KB | 12 Sep 2017 - 19:00 |
HTTrack off-line browser | 2 | 57.13 KB | 12 Sep 2017 - 16:11 |
Mail.ru bot | 1+1 | 91 Bytes | 11 Sep 2017 - 08:59 |
Netcraft | 2 | 8.03 KB | 07 Sep 2017 - 05:33 |
Phantom | 3 | 46.53 KB | 05 Sep 2017 - 21:05 |