33 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 10571+2 | 323.42 MB | 27 Jan 2017 - 15:33 |
Unknown robot (identified by 'bot*') | 5100+119 | 878.28 MB | 31 Jan 2017 - 23:46 |
Googlebot | 3302+439 | 2.18 GB | 31 Jan 2017 - 23:58 |
Yandex bot | 1941+164 | 203.52 MB | 31 Jan 2017 - 23:58 |
Yahoo Slurp | 1922+48 | 110.97 MB | 31 Jan 2017 - 23:20 |
BaiDuSpider | 1213+5 | 82.48 MB | 31 Jan 2017 - 23:35 |
Python-urllib | 677 | 13.73 MB | 20 Jan 2017 - 19:36 |
Java (Often spam bot) | 471 | 22.16 MB | 31 Jan 2017 - 20:45 |
Unknown robot (identified by hit on 'robots.txt') | 0+356 | 31.64 KB | 31 Jan 2017 - 20:40 |
Sogou Spider | 261+42 | 12.99 MB | 31 Jan 2017 - 23:06 |
Feedfetcher-Google | 124 | 1.97 MB | 31 Jan 2017 - 21:42 |
Nutch | 86+8 | 1.54 MB | 20 Jan 2017 - 12:55 |
Unknown robot (identified by 'spider') | 59+6 | 2.85 MB | 31 Jan 2017 - 22:19 |
MJ12bot | 28+29 | 292.40 KB | 30 Jan 2017 - 20:17 |
Unknown robot (identified by empty user agent string) | 39+2 | 373.45 KB | 30 Jan 2017 - 22:43 |
Unknown robot (identified by 'robot') | 17+14 | 1.46 MB | 31 Jan 2017 - 12:13 |
Harvest | 28 | 74.66 KB | 30 Jan 2017 - 17:51 |
yacy | 24+3 | 3.73 MB | 30 Jan 2017 - 07:55 |
MSNBot-media | 21 | 912.76 KB | 20 Jan 2017 - 12:35 |
Web Core / Roots | 20 | 554.49 KB | 18 Jan 2017 - 11:40 |
Unknown robot (identified by '*bot') | 15+3 | 670.59 KB | 23 Jan 2017 - 01:05 |
FavIconizer | 16 | 1.84 MB | 30 Jan 2017 - 19:00 |
UniversalFeedParser | 9 | 82.69 KB | 07 Jan 2017 - 07:19 |
Exabot | 5+4 | 31.12 KB | 27 Jan 2017 - 04:23 |
Perl tool | 9 | 41.46 KB | 26 Jan 2017 - 20:21 |
SeznamBot | 2+2 | 182 Bytes | 05 Jan 2017 - 11:00 |
Spiderman | 2 | 16.06 KB | 14 Jan 2017 - 14:49 |
HTTrack off-line browser | 2 | 81.01 KB | 18 Jan 2017 - 11:34 |
Netcraft | 2 | 8.03 KB | 09 Jan 2017 - 20:49 |
Sift | 1 | 20.68 KB | 25 Jan 2017 - 01:44 |
WGet tools | 1 | 2.93 MB | 10 Jan 2017 - 18:45 |
CFNetwork | 1 | 300.39 KB | 10 Jan 2017 - 07:15 |
LinkBot | 1 | 28.57 KB | 17 Jan 2017 - 17:18 |