Cherry-pick #19516 to 7.x: Prepare input/file for changes in the registrar

[urso]

Cherry-pick of PR #19516 to 7.x branch. Original message:

• Enhancement

What does this PR do?

Planned changes in the registrar will introduce a key-value store.
This changes prepares the input/file package for upcoming updates.

Why is it important?

This PR is part of the Filebeat v2 input.

Checklist

• My code follows the style guidelines of this project
  - [ ] I have commented my code, particularly in hard-to-understand areas
  - [ ] I have made corresponding changes to the documentation
  - [ ] I have made corresponding change to the default configuration files
  - [ ] I have added tests that prove my fix is effective or that my feature works
  - [ ] I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Author's Checklist

• [ ]

How to test this PR locally

Related issues

• Relates Filebeat input v2 API #15324

[elasticmachine]

Pinging @elastic/integrations-services (Team:Services)

[botelastic]

This pull request doesn't have a Team:<team> label.

[elasticmachine]

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

Expand to view the summary

Build stats

• Build Cause: [Pull request #19657 opened]

• Start Time: 2020-07-03T23:24:10.375+0000

• Duration: 124 min 55 sec

Test stats 🧪

Test	Results
Failed	0
Passed	3502
Skipped	677
Total	4179

Log output

Expand to view the last 100 lines of log output

[2020-07-04T01:27:37.064Z] 	at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
[2020-07-04T01:27:37.064Z] Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
[2020-07-04T01:27:37.064Z] 	at hudson.FilePath.act(FilePath.java:1071)
[2020-07-04T01:27:37.064Z] 	at hudson.FilePath.act(FilePath.java:1058)
[2020-07-04T01:27:37.064Z] 	at hudson.FilePath.validateAntFileMask(FilePath.java:2684)
[2020-07-04T01:27:37.064Z] 	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:265)
[2020-07-04T01:27:37.064Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:80)
[2020-07-04T01:27:37.064Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-07-04T01:27:37.064Z] 	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-07-04T01:27:37.064Z] 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-07-04T01:27:37.064Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-07-04T01:27:37.064Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-07-04T01:27:37.064Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-07-04T01:27:37.064Z] 	at java.lang.Thread.run(Thread.java:748)
[2020-07-04T01:27:37.064Z] No artifacts found that match the file pattern "**/build/TEST*.out". Configuration error?
[2020-07-04T01:27:37.543Z] + curl -sSLo codecov https://codecov.io/bash
[2020-07-04T01:27:37.805Z] + FILE=auditbeat/build/coverage/full.cov
[2020-07-04T01:27:37.805Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-07-04T01:27:37.805Z] + FILE=filebeat/build/coverage/full.cov
[2020-07-04T01:27:37.805Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-07-04T01:27:37.805Z] + FILE=heartbeat/build/coverage/full.cov
[2020-07-04T01:27:37.805Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-07-04T01:27:37.805Z] + FILE=libbeat/build/coverage/full.cov
[2020-07-04T01:27:37.805Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-07-04T01:27:37.805Z] + FILE=metricbeat/build/coverage/full.cov
[2020-07-04T01:27:37.805Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-07-04T01:27:37.805Z] + FILE=packetbeat/build/coverage/full.cov
[2020-07-04T01:27:37.805Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-07-04T01:27:37.805Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-07-04T01:27:37.805Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-07-04T01:27:37.805Z] + FILE=journalbeat/build/coverage/full.cov
[2020-07-04T01:27:37.805Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-07-04T01:27:37.914Z] + curl -sSLo codecov https://codecov.io/bash
[2020-07-04T01:27:38.189Z] + FILE=auditbeat/build/coverage/full.cov
[2020-07-04T01:27:38.189Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-07-04T01:27:38.189Z] + FILE=filebeat/build/coverage/full.cov
[2020-07-04T01:27:38.189Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-07-04T01:27:38.189Z] + FILE=heartbeat/build/coverage/full.cov
[2020-07-04T01:27:38.189Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-07-04T01:27:38.189Z] + FILE=libbeat/build/coverage/full.cov
[2020-07-04T01:27:38.189Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-07-04T01:27:38.189Z] + FILE=metricbeat/build/coverage/full.cov
[2020-07-04T01:27:38.189Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-07-04T01:27:38.189Z] + FILE=packetbeat/build/coverage/full.cov
[2020-07-04T01:27:38.189Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-07-04T01:27:38.189Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-07-04T01:27:38.189Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-07-04T01:27:38.189Z] + FILE=journalbeat/build/coverage/full.cov
[2020-07-04T01:27:38.189Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-07-04T01:27:39.325Z] Failed in branch Filebeat oss
[2020-07-04T01:27:39.560Z] Failed in branch Filebeat x-pack
[2020-07-04T01:27:41.161Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats
[2020-07-04T01:27:41.503Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-07-04T01:27:41.525Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats/Lint
[2020-07-04T01:27:41.670Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-07-04T01:27:41.816Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-07-04T01:27:41.959Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats/Filebeat-Windows
[2020-07-04T01:27:42.102Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-07-04T01:27:42.247Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats/Filebeat-oss
[2020-07-04T01:27:42.394Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats/Filebeat-x-pack
[2020-07-04T01:27:42.830Z] + cat
[2020-07-04T01:27:42.830Z] + /usr/local/bin/runbld ./runbld-script
[2020-07-04T01:27:42.830Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-07-04T01:27:49.450Z] runbld>>> runbld started
[2020-07-04T01:27:49.450Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-07-04T01:27:52.012Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-19657' in order of occurrence in the config (last value wins).
[2020-07-04T01:27:52.960Z] runbld>>> Debug logging enabled.
[2020-07-04T01:27:52.960Z] runbld>>> Storing result
[2020-07-04T01:27:52.960Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-07-04T01:27:52.960Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200704012752-CC86A8CE
[2020-07-04T01:27:53.229Z] runbld>>> Adding system facts.
[2020-07-04T01:27:54.178Z] runbld>>> Adding vcs info for the latest commit:  8c14932457308a88b2f00260663834c76960e225
[2020-07-04T01:27:54.178Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-07-04T01:27:54.178Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-07-04T01:27:54.178Z] + echo 'Processing JUnit reports with runbld...'
[2020-07-04T01:27:54.178Z] Processing JUnit reports with runbld...
[2020-07-04T01:27:54.440Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-07-04T01:27:54.440Z] runbld>>> DURATION: 14ms
[2020-07-04T01:27:54.440Z] runbld>>> STDOUT: 40 bytes
[2020-07-04T01:27:54.440Z] runbld>>> STDERR: 49 bytes
[2020-07-04T01:27:54.440Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-07-04T01:27:54.440Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats
[2020-07-04T01:27:55.832Z] runbld>>> Storing build metadata: 
[2020-07-04T01:27:55.832Z] runbld>>> Adding test report.
[2020-07-04T01:27:55.832Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657/src/github.com/elastic/beats
[2020-07-04T01:27:56.406Z] runbld>>> Found 11 test output files
[2020-07-04T01:27:57.353Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 4179 Skipped: 653
[2020-07-04T01:27:57.615Z] runbld>>> Storing result
[2020-07-04T01:27:57.615Z] runbld>>> FAILURES: 0
[2020-07-04T01:27:57.877Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-07-04T01:27:57.877Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200704012752-CC86A8CE
[2020-07-04T01:27:57.877Z] runbld>>> Email notification disabled by environment variable.
[2020-07-04T01:27:57.877Z] runbld>>> Slack notification disabled by environment variable.
[2020-07-04T01:28:03.958Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19657
[2020-07-04T01:28:04.247Z] [INFO] getVaultSecret: Getting secrets
[2020-07-04T01:28:04.315Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-07-04T01:28:05.331Z] + chmod 755 generate-build-data.sh
[2020-07-04T01:28:05.331Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19657/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19657/runs/1 ABORTED 7434686
[2020-07-04T01:28:05.331Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19657/runs/1/steps/?limit=10000 -o steps-info.json
[2020-07-04T01:28:05.882Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19657/runs/1/tests/?status=FAILED -o tests-errors.json