^C ± ~/work/kibana [master @ 3541edb] ✓ ‣ yarn es snapshot --license=trial -E xpack.security.authc.api_key.enabled=true yarn run v1.22.4 $ node scripts/es snapshot --license=trial -E xpack.security.authc.api_key.enabled=true info Installing from snapshot │ info version: 8.0.0 │ info install path: /Users/jfsiii/work/kibana/.es/8.0.0 │ info license: trial │ info Downloading snapshot manifest from https://storage.googleapis.com/kibana-ci-es-snapshots-daily/8.0.0/manifest-latest-verified.json │ info verifying cache of https://storage.googleapis.com/kibana-ci-es-snapshots-daily/8.0.0/archives/20200820-194443_8989a64/elasticsearch-8.0.0-SNAPSHOT-darwin-x86_64.tar.gz │ info etags match, reusing cache from 2020-08-20T23:14:10.784Z │ info install directory already exists, removing │ info extracting /Users/jfsiii/work/kibana/.es/cache/elasticsearch-8.0.0-SNAPSHOT-darwin-x86_64.tar.gz │ info extracted to /Users/jfsiii/work/kibana/.es/8.0.0 │ info created /Users/jfsiii/work/kibana/.es/8.0.0/ES_TMPDIR │ info setting secure setting bootstrap.password to changeme info Starting │ debg bin/elasticsearch -E xpack.security.authc.api_key.enabled=true │ info [o.e.n.Node] [JFSIII.local] version[8.0.0-SNAPSHOT], pid[20086], build[default/tar/8989a6483a2d9452c5dc8cd983bff58a808a5826/2020-08-20T19:31:42.932737Z], OS[Mac OS X/10.14.6/x86_64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/14.0.1/14.0.1+7] │ info [o.e.n.Node] [JFSIII.local] JVM home [/Users/jfsiii/work/kibana/.es/8.0.0/jdk.app/Contents/Home] │ info [o.e.n.Node] [JFSIII.local] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/Users/jfsiii/work/kibana/.es/8.0.0/ES_TMPDIR, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/Users/jfsiii/work/kibana/.es/8.0.0, -Des.path.conf=/Users/jfsiii/work/kibana/.es/8.0.0/config, -Des.distribution.flavor=default, -Des.distribution.type=tar, -Des.bundled_jdk=true] │ info [o.e.n.Node] [JFSIII.local] version [8.0.0-SNAPSHOT] is a pre-release version of Elasticsearch and is not suitable for production │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [aggs-matrix-stats] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [analysis-common] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [constant-keyword] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [flattened] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [frozen-indices] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [ingest-common] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [ingest-geoip] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [ingest-user-agent] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [kibana] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [lang-expression] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [lang-mustache] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [lang-painless] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [mapper-extras] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [parent-join] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [percolator] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [rank-eval] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [reindex] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [repository-url] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [search-business-rules] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [searchable-snapshots] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [spatial] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [tasks] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [transform] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [transport-netty4] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [vectors] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [wildcard] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-analytics] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-async] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-async-search] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-autoscaling] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-ccr] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-core] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-data-streams] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-deprecation] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-enrich] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-eql] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-graph] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-identity-provider] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-ilm] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-logstash] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-ml] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-monitoring] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-ql] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-rollup] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-security] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-sql] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-stack] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-voting-only-node] │ info [o.e.p.PluginsService] [JFSIII.local] loaded module [x-pack-watcher] │ info [o.e.p.PluginsService] [JFSIII.local] no plugins loaded │ info [o.e.e.NodeEnvironment] [JFSIII.local] using [1] data paths, mounts [[/ (/dev/disk1s1)]], net usable_space [210.5gb], net total_space [465.6gb], types [apfs] │ info [o.e.e.NodeEnvironment] [JFSIII.local] heap size [1gb], compressed ordinary object pointers [true] │ info [o.e.n.Node] [JFSIII.local] node name [JFSIII.local], node ID [A6WP2BwUTLSIPcXLtqATRw], cluster name [elasticsearch], roles [transform, data, remote_cluster_client, master, ml, ingest] │ info [o.e.x.m.p.l.CppLogMessageHandler] [JFSIII.local] [controller/20380] [Main.cc@114] controller (64 bit): Version 8.0.0-SNAPSHOT (Build 77f7871f9b7804) Copyright (c) 2020 Elasticsearch BV │ info [o.e.x.s.a.s.FileRolesStore] [JFSIII.local] parsed [0] roles from file [/Users/jfsiii/work/kibana/.es/8.0.0/config/roles.yml] │ info [o.e.d.DiscoveryModule] [JFSIII.local] using discovery type [zen] and seed hosts providers [settings] │ info [o.e.n.Node] [JFSIII.local] initialized │ info [o.e.n.Node] [JFSIII.local] starting ... │ info [o.e.t.TransportService] [JFSIII.local] publish_address {127.0.0.1:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300} │ info [o.e.b.BootstrapChecks] [JFSIII.local] the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured │ info [o.e.b.BootstrapChecks] [JFSIII.local] HTTPS is required in order to use the API key service; please enable HTTPS using the [xpack.security.http.ssl.enabled] setting or disable the API key service using the [xpack.security.authc.api_key.enabled] setting │ info [o.e.c.c.ClusterBootstrapService] [JFSIII.local] no discovery configuration found, will perform best-effort cluster bootstrapping after [3s] unless existing master is discovered │ info [o.e.c.c.Coordinator] [JFSIII.local] setting initial configuration to VotingConfiguration{A6WP2BwUTLSIPcXLtqATRw} │ info [o.e.c.s.MasterService] [JFSIII.local] elected-as-master ([1] nodes joined)[{JFSIII.local}{A6WP2BwUTLSIPcXLtqATRw}{pqZoH8CgRDSAvMHe3AxNUQ}{127.0.0.1}{127.0.0.1:9300}{dilmrt}{ml.machine_memory=34359738368, xpack.installed=true, transform.node=true, ml.max_open_jobs=20} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: master node changed {previous [], current [{JFSIII.local}{A6WP2BwUTLSIPcXLtqATRw}{pqZoH8CgRDSAvMHe3AxNUQ}{127.0.0.1}{127.0.0.1:9300}{dilmrt}{ml.machine_memory=34359738368, xpack.installed=true, transform.node=true, ml.max_open_jobs=20}]} │ info [o.e.c.c.CoordinationState] [JFSIII.local] cluster UUID set to [PCDV-j_GRyyKwoSrK8B6iw] │ info [o.e.c.s.ClusterApplierService] [JFSIII.local] master node changed {previous [], current [{JFSIII.local}{A6WP2BwUTLSIPcXLtqATRw}{pqZoH8CgRDSAvMHe3AxNUQ}{127.0.0.1}{127.0.0.1:9300}{dilmrt}{ml.machine_memory=34359738368, xpack.installed=true, transform.node=true, ml.max_open_jobs=20}]}, term: 1, version: 1, reason: Publication{term=1, version=1} │ info [o.e.h.AbstractHttpServerTransport] [JFSIII.local] publish_address {127.0.0.1:9200}, bound_addresses {[::1]:9200}, {127.0.0.1:9200} │ info [o.e.n.Node] [JFSIII.local] started │ info [o.e.g.GatewayService] [JFSIII.local] recovered [0] indices into cluster_state │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding component template [logs-mappings] │ info [o.e.x.s.s.SecurityIndexManager] [JFSIII.local] security index does not exist. Creating [.security-7] with alias [.security] │ info [o.e.x.s.s.SecurityIndexManager] [JFSIII.local] security index does not exist. Creating [.security-7] with alias [.security] │ info [o.e.x.s.s.SecurityIndexManager] [JFSIII.local] security index does not exist. Creating [.security-7] with alias [.security] │ info [o.e.x.s.s.SecurityIndexManager] [JFSIII.local] security index does not exist. Creating [.security-7] with alias [.security] │ info [o.e.x.s.s.SecurityIndexManager] [JFSIII.local] security index does not exist. Creating [.security-7] with alias [.security] │ info [o.e.x.s.s.SecurityIndexManager] [JFSIII.local] security index does not exist. Creating [.security-7] with alias [.security] │ info [o.e.x.s.s.SecurityIndexManager] [JFSIII.local] security index does not exist. Creating [.security-7] with alias [.security] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding component template [metrics-settings] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding component template [metrics-mappings] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding component template [logs-settings] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.ml-notifications-000001] for index patterns [.ml-notifications-000001] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.ml-meta] for index patterns [.ml-meta] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.ml-inference-000003] for index patterns [.ml-inference-000003] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.ml-config] for index patterns [.ml-config] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.ml-state] for index patterns [.ml-state*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.ml-anomalies-] for index patterns [.ml-anomalies-*] │ info [o.e.x.s.a.AuthenticationService] [JFSIII.local] Authentication of [kibana_system] was terminated by realm [reserved] - failed to authenticate user [kibana_system] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.ml-stats] for index patterns [.ml-stats-*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.watches] for index patterns [.watches*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.triggered_watches] for index patterns [.triggered_watches*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [ilm-history] for index patterns [ilm-history-2*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.slm-history] for index patterns [.slm-history-2*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.watch-history-11] for index patterns [.watcher-history-11*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.monitoring-logstash] for index patterns [.monitoring-logstash-7-*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.monitoring-es] for index patterns [.monitoring-es-7-*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.monitoring-beats] for index patterns [.monitoring-beats-7-*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.monitoring-alerts-7] for index patterns [.monitoring-alerts-7] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.monitoring-kibana] for index patterns [.monitoring-kibana-7-*] │ info [o.e.c.m.MetadataCreateIndexService] [JFSIII.local] [.security-7] creating index, cause [api], templates [], shards [1]/[0] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding index template [metrics] for index patterns [metrics-*-*] │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding index template [logs] for index patterns [logs-*-*] │ info [o.e.x.s.a.e.ReservedRealm] [JFSIII.local] failed to retrieve password hash for reserved user [kibana_system] │ org.elasticsearch.action.UnavailableShardsException: at least one primary shard for the index [.security-7] is unavailable │ at org.elasticsearch.xpack.security.support.SecurityIndexManager.getUnavailableReason(SecurityIndexManager.java:174) ~[x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.esnative.NativeUsersStore.getReservedUserInfo(NativeUsersStore.java:524) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.esnative.ReservedRealm.getUserInfo(ReservedRealm.java:221) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.esnative.ReservedRealm.doAuthenticate(ReservedRealm.java:99) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.authenticateWithCache(CachingUsernamePasswordRealm.java:167) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.authenticate(CachingUsernamePasswordRealm.java:104) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$consumeToken$15(AuthenticationService.java:448) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.core.common.IteratingActionListener.run(IteratingActionListener.java:102) [x-pack-core-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.consumeToken(AuthenticationService.java:503) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$extractToken$11(AuthenticationService.java:415) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.extractToken(AuthenticationService.java:425) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$checkForApiKey$3(AuthenticationService.java:366) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.ApiKeyService.authenticateWithApiKeyIfPresent(ApiKeyService.java:335) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.checkForApiKey(AuthenticationService.java:347) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$0(AuthenticationService.java:329) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.TokenService.getAndValidateToken(TokenService.java:404) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:325) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:384) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:395) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:320) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:141) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:126) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.rest.SecurityRestFilter.handleRequest(SecurityRestFilter.java:63) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:234) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:316) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:174) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.AbstractHttpServerTransport.dispatchRequest(AbstractHttpServerTransport.java:318) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.AbstractHttpServerTransport.handleIncomingRequest(AbstractHttpServerTransport.java:372) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.AbstractHttpServerTransport.incomingRequest(AbstractHttpServerTransport.java:308) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:42) [transport-netty4-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:28) [transport-netty4-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at org.elasticsearch.http.netty4.Netty4HttpPipeliningHandler.channelRead(Netty4HttpPipeliningHandler.java:58) [transport-netty4-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.MessageToMessageCodec.channelRead(MessageToMessageCodec.java:111) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ info at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final] │ at java.lang.Thread.run(Thread.java:832) [?:?] │ info [o.e.x.s.a.AuthenticationService] [JFSIII.local] Authentication of [kibana_system] was terminated by realm [reserved] - failed to authenticate user [kibana_system] │ info [o.e.x.s.a.AuthenticationService] [JFSIII.local] Authentication of [kibana_system] was terminated by realm [reserved] - failed to authenticate user [kibana_system] │ info [o.e.x.s.a.e.ReservedRealm] [JFSIII.local] failed to retrieve password hash for reserved user [kibana_system] │ org.elasticsearch.action.UnavailableShardsException: at least one primary shard for the index [.security-7] is unavailable │ at org.elasticsearch.xpack.security.support.SecurityIndexManager.getUnavailableReason(SecurityIndexManager.java:174) ~[x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.esnative.NativeUsersStore.getReservedUserInfo(NativeUsersStore.java:524) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.esnative.ReservedRealm.getUserInfo(ReservedRealm.java:221) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.esnative.ReservedRealm.doAuthenticate(ReservedRealm.java:99) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.authenticateWithCache(CachingUsernamePasswordRealm.java:167) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.authenticate(CachingUsernamePasswordRealm.java:104) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$consumeToken$15(AuthenticationService.java:448) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.core.common.IteratingActionListener.run(IteratingActionListener.java:102) [x-pack-core-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.consumeToken(AuthenticationService.java:503) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$extractToken$11(AuthenticationService.java:415) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.extractToken(AuthenticationService.java:425) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$checkForApiKey$3(AuthenticationService.java:366) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.ApiKeyService.authenticateWithApiKeyIfPresent(ApiKeyService.java:335) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.checkForApiKey(AuthenticationService.java:347) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$0(AuthenticationService.java:329) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.TokenService.getAndValidateToken(TokenService.java:404) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:325) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:384) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:395) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:320) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:141) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:126) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.xpack.security.rest.SecurityRestFilter.handleRequest(SecurityRestFilter.java:63) [x-pack-security-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:234) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:316) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:174) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.AbstractHttpServerTransport.dispatchRequest(AbstractHttpServerTransport.java:318) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.AbstractHttpServerTransport.handleIncomingRequest(AbstractHttpServerTransport.java:372) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.AbstractHttpServerTransport.incomingRequest(AbstractHttpServerTransport.java:308) [elasticsearch-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:42) [transport-netty4-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:28) [transport-netty4-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at org.elasticsearch.http.netty4.Netty4HttpPipeliningHandler.channelRead(Netty4HttpPipeliningHandler.java:58) [transport-netty4-8.0.0-SNAPSHOT.jar:8.0.0-SNAPSHOT] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.handler.codec.MessageToMessageCodec.channelRead(MessageToMessageCodec.java:111) [netty-codec-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] │ info [o.e.x.s.a.AuthenticationService] [JFSIII.local] Authentication of [kibana_system] was terminated by realm [reserved] - failed to authenticate user [kibana_system] │ info [o.e.x.s.a.AuthenticationService] [JFSIII.local] Authentication of [kibana_system] was terminated by realm [reserved] - failed to authenticate user [kibana_system] │ info [o.e.c.r.a.AllocationService] [JFSIII.local] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.security-7][0]]])." previous.health="YELLOW" reason="shards started [[.security-7][0]]" │ info [o.e.x.i.a.TransportPutLifecycleAction] [JFSIII.local] adding index lifecycle policy [ml-size-based-ilm-policy] │ info [o.e.x.i.a.TransportPutLifecycleAction] [JFSIII.local] adding index lifecycle policy [logs] │ info [o.e.x.i.a.TransportPutLifecycleAction] [JFSIII.local] adding index lifecycle policy [metrics] │ info [o.e.x.i.a.TransportPutLifecycleAction] [JFSIII.local] adding index lifecycle policy [watch-history-ilm-policy] │ info [o.e.x.i.a.TransportPutLifecycleAction] [JFSIII.local] adding index lifecycle policy [ilm-history-ilm-policy] │ info [o.e.x.i.a.TransportPutLifecycleAction] [JFSIII.local] adding index lifecycle policy [slm-history-ilm-policy] │ info [o.e.l.LicenseService] [JFSIII.local] license [67f6d3e9-f5f3-45c7-8119-c9b68e1b6f85] mode [trial] - valid │ info [o.e.x.s.s.SecurityStatusChangeListener] [JFSIII.local] Active license is now [TRIAL]; Security is enabled │ info [o.e.c.m.MetadataIndexTemplateService] [JFSIII.local] adding template [.kibana_security_session_index_template_1] for index patterns [.kibana_security_session_1] │ info [o.e.c.m.MetadataCreateIndexService] [JFSIII.local] [.kibana_task_manager] creating index, cause [auto(bulk api)], templates [], shards [1]/[1] │ info [o.e.c.m.MetadataCreateIndexService] [JFSIII.local] [.kibana] creating index, cause [auto(bulk api)], templates [], shards [1]/[1] │ info [o.e.c.m.MetadataCreateIndexService] [JFSIII.local] [.kibana_security_session_1] creating index, cause [api], templates [.kibana_security_session_index_template_1], shards [1]/[0] │ info [o.e.c.m.MetadataMappingService] [JFSIII.local] [.kibana_task_manager/i7J1-qo2QZinAawX2-uM3w] create_mapping │ info [o.e.c.m.MetadataMappingService] [JFSIII.local] [.kibana/G5xSRKgVRue6v3xtIeM5gQ] create_mapping │ info [o.e.c.m.MetadataMappingService] [JFSIII.local] [.kibana/G5xSRKgVRue6v3xtIeM5gQ] update_mapping [_doc] │ info [o.e.c.m.MetadataMappingService] [JFSIII.local] [.kibana/G5xSRKgVRue6v3xtIeM5gQ] update_mapping [_doc]