31 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 11310+12 | 344.76 MB | 29 Mar 2017 - 21:52 |
Unknown robot (identified by 'bot*') | 6144+231 | 1.04 GB | 31 Mar 2017 - 23:24 |
Googlebot | 4403+570 | 2.74 GB | 31 Mar 2017 - 23:58 |
Yandex bot | 1955+85 | 269.23 MB | 31 Mar 2017 - 03:03 |
Yahoo Slurp | 1555+37 | 114.09 MB | 31 Mar 2017 - 22:10 |
BaiDuSpider | 1478+11 | 87.69 MB | 31 Mar 2017 - 23:44 |
Java (Often spam bot) | 312 | 4.81 MB | 31 Mar 2017 - 23:31 |
Sogou Spider | 196+43 | 15.70 MB | 31 Mar 2017 - 13:33 |
Unknown robot (identified by hit on 'robots.txt') | 0+214 | 19.02 KB | 31 Mar 2017 - 23:46 |
Feedfetcher-Google | 124 | 1.97 MB | 31 Mar 2017 - 22:59 |
Nutch | 83+11 | 7.32 MB | 26 Mar 2017 - 08:07 |
Unknown robot (identified by 'spider') | 85+7 | 4.53 MB | 31 Mar 2017 - 16:13 |
MJ12bot | 34+33 | 259.93 KB | 31 Mar 2017 - 21:45 |
MSNBot-media | 62 | 1.35 MB | 31 Mar 2017 - 19:11 |
Unknown robot (identified by empty user agent string) | 51+2 | 774.73 KB | 30 Mar 2017 - 19:00 |
Unknown robot (identified by 'robot') | 33+18 | 1.75 MB | 30 Mar 2017 - 17:00 |
Exabot | 30+9 | 1.51 MB | 29 Mar 2017 - 02:36 |
Harvest | 38 | 709.83 KB | 31 Mar 2017 - 15:45 |
larbin | 37+1 | 735.03 KB | 03 Mar 2017 - 19:51 |
Unknown robot (identified by '*bot') | 24+6 | 1.87 MB | 31 Mar 2017 - 21:56 |
Python-urllib | 17 | 8.43 MB | 31 Mar 2017 - 11:31 |
FavIconizer | 17 | 1.31 MB | 30 Mar 2017 - 09:40 |
yacy | 13+2 | 1.34 MB | 27 Mar 2017 - 08:39 |
UniversalFeedParser | 13 | 529.72 KB | 31 Mar 2017 - 21:48 |
Phantom | 12 | 2.09 MB | 18 Mar 2017 - 03:53 |
Web Core / Roots | 10 | 328.15 KB | 24 Mar 2017 - 22:46 |
Perl tool | 10 | 41.79 KB | 30 Mar 2017 - 20:42 |
Alexa (IA Archiver) | 4+3 | 3.81 MB | 29 Mar 2017 - 11:53 |
HTTrack off-line browser | 5 | 138.62 KB | 21 Mar 2017 - 08:43 |
Netcraft | 2 | 8.03 KB | 09 Mar 2017 - 01:31 |
LinkWalker | 0+1 | 91 Bytes | 31 Mar 2017 - 09:49 |