Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Elastic Agent] add heartbeat to Elastic Agent monitoring datasets #107989

Conversation

dominiqueclarke
Copy link
Contributor

@dominiqueclarke dominiqueclarke commented Aug 10, 2021

Relates to elastic/beats#27238

Summary

This PR adds heartbeat to the hardcoded list of Elastic Agent monitoring datasets.

Works in conjunction with elastic/integrations#1460 to ensure that heartbeat logs are available from agent.

@dominiqueclarke dominiqueclarke added bug Fixes for quality problems that affect the customer experience v8.0.0 Team:Uptime - DEPRECATED Synthetics & RUM sub-team of Application Observability release_note:skip Skip the PR/issue when compiling release notes auto-backport Deprecated - use backport:version if exact versions are needed v7.15.0 v7.14.1 labels Aug 10, 2021
@dominiqueclarke dominiqueclarke requested a review from a team as a code owner August 10, 2021 00:58
@elasticmachine
Copy link
Contributor

Pinging @elastic/uptime (Team:uptime)

@botelastic botelastic bot added the Team:Fleet Team label for Observability Data Collection Fleet team label Aug 10, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@dominiqueclarke dominiqueclarke force-pushed the fix/27238-add-heartbeat-to-fleet-monitoring-datasets branch from b4c4855 to 7d89a9f Compare August 10, 2021 01:22
@kibanamachine
Copy link
Contributor

💛 Build succeeded, but was flaky


Test Failures

Kibana Pipeline / general / Chrome UI Functional Tests.test/functional/apps/management/_index_pattern_create_delete·js.management creating and deleting default index validation can display errors

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 14 times on tracked branches: https://github.com/elastic/kibana/issues/107831

[00:00:00]       │
[00:00:00]         └-: management
[00:00:00]           └-> "before all" hook in "management"
[00:00:00]           └-> "before all" hook in "management"
[00:00:00]             │ info [test/functional/fixtures/es_archiver/logstash_functional] Unloading indices from "mappings.json"
[00:00:00]             │ info [test/functional/fixtures/es_archiver/logstash_functional] Unloading indices from "data.json.gz"
[00:00:01]             │ info [test/functional/fixtures/es_archiver/makelogs] Loading "mappings.json"
[00:00:01]             │ info [test/functional/fixtures/es_archiver/makelogs] Loading "data.json.gz"
[00:00:01]             │ info [o.e.c.m.MetadataCreateIndexService] [node-01] [logstash-2015.09.17] creating index, cause [api], templates [], shards [1]/[0]
[00:00:01]             │ info [o.e.c.r.a.AllocationService] [node-01] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.17][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.17][0]]"
[00:00:01]             │ info [test/functional/fixtures/es_archiver/makelogs] Created index "logstash-2015.09.17"
[00:00:01]             │ debg [test/functional/fixtures/es_archiver/makelogs] "logstash-2015.09.17" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:01]             │ info [o.e.x.i.IndexLifecycleTransition] [node-01] moving index [.ds-ilm-history-5-2021.08.10-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [ilm-history-ilm-policy]
[00:00:01]             │ info [o.e.c.m.MetadataCreateIndexService] [node-01] [logstash-2015.09.18] creating index, cause [api], templates [], shards [1]/[0]
[00:00:01]             │ info [o.e.c.r.a.AllocationService] [node-01] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.18][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.18][0]]"
[00:00:01]             │ info [test/functional/fixtures/es_archiver/makelogs] Created index "logstash-2015.09.18"
[00:00:01]             │ debg [test/functional/fixtures/es_archiver/makelogs] "logstash-2015.09.18" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:01]             │ info [o.e.x.i.IndexLifecycleTransition] [node-01] moving index [.ds-ilm-history-5-2021.08.10-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [ilm-history-ilm-policy]
[00:00:01]             │ info [test/functional/fixtures/es_archiver/makelogs] Indexed 101 docs into "logstash-2015.09.17"
[00:00:01]             │ info [test/functional/fixtures/es_archiver/makelogs] Indexed 301 docs into "logstash-2015.09.18"
[00:00:02]           └-: 
[00:00:02]             └-> "before all" hook in ""
[00:00:26]             └-: creating and deleting default index
[00:00:26]               └-> "before all" hook in "creating and deleting default index"
[00:00:26]               └-> "before all" hook in "creating and deleting default index"
[00:00:26]                 │ debg replacing kibana config doc: {}
[00:00:27]                 │ debg navigating to settings url: http://localhost:6171/app/management
[00:00:27]                 │ debg navigate to: http://localhost:6171/app/management
[00:00:27]                 │ debg browser[INFO] http://localhost:6171/app/management?_t=1628561617821 281 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:27]                 │
[00:00:27]                 │ debg browser[INFO] http://localhost:6171/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:27]                 │ debg ... sleep(700) start
[00:00:27]                 │ debg ... sleep(700) end
[00:00:27]                 │ debg returned from get, calling refresh
[00:00:28]                 │ debg browser[INFO] http://localhost:6171/app/management?_t=1628561617821 281 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:28]                 │
[00:00:28]                 │ debg browser[INFO] http://localhost:6171/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:29]                 │ debg currentUrl = http://localhost:6171/app/management
[00:00:29]                 │          appUrl = http://localhost:6171/app/management
[00:00:29]                 │ debg TestSubjects.find(kibanaChrome)
[00:00:29]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:00:29]                 │ debg ... sleep(501) start
[00:00:29]                 │ debg ... sleep(501) end
[00:00:29]                 │ debg in navigateTo url = http://localhost:6171/app/management
[00:00:29]                 │ debg clickKibanaIndexPatterns link
[00:00:29]                 │ debg TestSubjects.click(indexPatterns)
[00:00:29]                 │ debg Find.clickByCssSelector('[data-test-subj="indexPatterns"]') with timeout=10000
[00:00:29]                 │ debg Find.findByCssSelector('[data-test-subj="indexPatterns"]') with timeout=10000
[00:00:29]                 │ debg isGlobalLoadingIndicatorVisible
[00:00:29]                 │ debg TestSubjects.exists(globalLoadingIndicator)
[00:00:29]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:00:31]                 │ debg --- retry.tryForTime error: [data-test-subj="globalLoadingIndicator"] is not displayed
[00:00:31]                 │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:00:31]                 │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:00:34]               └-: validation
[00:00:34]                 └-> "before all" hook for "can display errors"
[00:00:34]                 └-> can display errors
[00:00:34]                   └-> "before each" hook: global before each for "can display errors"
[00:00:34]                   │ debg TestSubjects.exists(createIndexPatternButtonFlyout)
[00:00:34]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createIndexPatternButtonFlyout"]') with timeout=2500
[00:00:36]                   │ debg --- retry.tryForTime error: [data-test-subj="createIndexPatternButtonFlyout"] is not displayed
[00:00:37]                   │ debg TestSubjects.exists(createIndexPatternButton)
[00:00:37]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createIndexPatternButton"]') with timeout=2500
[00:00:37]                   │ debg TestSubjects.click(createIndexPatternButton)
[00:00:37]                   │ debg Find.clickByCssSelector('[data-test-subj="createIndexPatternButton"]') with timeout=10000
[00:00:37]                   │ debg Find.findByCssSelector('[data-test-subj="createIndexPatternButton"]') with timeout=10000
[00:00:37]                   │ debg TestSubjects.exists(createIndexPatternButtonFlyout)
[00:00:37]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createIndexPatternButtonFlyout"]') with timeout=2500
[00:00:37]                   │ debg TestSubjects.click(createIndexPatternButtonFlyout)
[00:00:37]                   │ debg Find.clickByCssSelector('[data-test-subj="createIndexPatternButtonFlyout"]') with timeout=10000
[00:00:37]                   │ debg Find.findByCssSelector('[data-test-subj="createIndexPatternButtonFlyout"]') with timeout=10000
[00:00:37]                   │ debg setIndexPatternField(log*)
[00:00:37]                   │ debg TestSubjects.find(createIndexPatternNameInput)
[00:00:37]                   │ debg Find.findByCssSelector('[data-test-subj="createIndexPatternNameInput"]') with timeout=10000
[00:00:38]                   │ debg setIndexPatternField set to log*
[00:00:38]                   │ debg TestSubjects.find(saveIndexPatternButton)
[00:00:38]                   │ debg Find.findByCssSelector('[data-test-subj="saveIndexPatternButton"]') with timeout=10000
[00:00:38]                   │ debg Find.findByClassName('euiFormErrorText') with timeout=10000
[00:00:48]                   │ info Taking screenshot "/dev/shm/workspace/parallel/7/kibana/test/functional/screenshots/failure/management  creating and deleting default index validation can display errors.png"
[00:00:48]                   │ info Current URL is: http://localhost:6171/app/management/kibana/indexPatterns/patterns/99b5ca10-f980-11eb-a868-a7ed516b408a#/?_a=(tab:indexedFields)
[00:00:48]                   │ info Saving page source to: /dev/shm/workspace/parallel/7/kibana/test/functional/failure_debug/html/management  creating and deleting default index validation can display errors.html
[00:00:48]                   └- ✖ fail: management  creating and deleting default index validation can display errors
[00:00:48]                   │      TimeoutError: Waiting for element to be located By(css selector, .euiFormErrorText)
[00:00:48]                   │ Wait timed out after 10041ms
[00:00:48]                   │       at /dev/shm/workspace/parallel/7/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
[00:00:48]                   │       at runMicrotasks (<anonymous>)
[00:00:48]                   │       at processTicksAndRejections (internal/process/task_queues.js:95:5)
[00:00:48]                   │ 
[00:00:48]                   │ 

Stack Trace

TimeoutError: Waiting for element to be located By(css selector, .euiFormErrorText)
Wait timed out after 10041ms
    at /dev/shm/workspace/parallel/7/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5) {
  remoteStacktrace: ''
}

Metrics [docs]

✅ unchanged

History

  • 💔 Build #143926 failed b4c48550db5c3aa1bea2cb67b59465f27b5fc4b0

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@dominiqueclarke dominiqueclarke merged commit ad0760d into elastic:master Aug 10, 2021
@dominiqueclarke dominiqueclarke deleted the fix/27238-add-heartbeat-to-fleet-monitoring-datasets branch August 10, 2021 12:45
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Aug 10, 2021
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Aug 10, 2021
@kibanamachine
Copy link
Contributor

💚 Backport successful

Status Branch Result
7.x
7.14

The backport PRs will be merged automatically after passing CI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Deprecated - use backport:version if exact versions are needed bug Fixes for quality problems that affect the customer experience release_note:skip Skip the PR/issue when compiling release notes Team:Fleet Team label for Observability Data Collection Fleet team Team:Uptime - DEPRECATED Synthetics & RUM sub-team of Application Observability v7.14.1 v7.15.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants