smoke: Remove usage of artifacts API #9233

marclop · 2022-09-29T05:20:02Z

Motivation/summary

Removes the usage of the Elastic artifacts API, in favor of using the Elastic Cloud API to obtain all the stack pack versions available in the configured ESS region.

This approach is better than using the artifacts API for two reasons:

1. Artifacts API and ESS regions may have different stack packs
2. Unused artifacts are removed after 30 days.

By using the ESS API, we no longer will see failures due to a missing BC or old versions removed (or the 7.17.x older versions).

Last, it also adds the SKIP_DESTROY conditional to all the test.sh scripts.

Checklist

~~- [ ] Update CHANGELOG.asciidoc~~
~~- [ ] Update package changelog.yml (only if changes to apmpackage have been made)~~
~~- [ ] Documentation has been updated~~

How to test these changes

Run smoke tests for version 7.17:
make smoketest/all SMOKETEST_VERSIONS=7.17

Related issues

Supersedes ##9225

Removes the usage of the Elastic artifacts API, in favor of using the Elastic Cloud API to obtain all the stack pack versions available in the configured ESS region. This approach is better than using the artifacts API for two reasons: 1. Artifacts API and ESS regions may have different stack packs 2. Unused artifacts are removed after 30 days. By using the ESS API, we no longer will see failures due to a missing BC or old versions removed (or the `7.17.x` older versions). Last, it also adds the `SKIP_DESTROY` conditional to all the `test.sh` scrits. Signed-off-by: Marc Lopez Rubio <[email protected]>

apmmachine · 2022-09-29T05:22:13Z

❕ Build Aborted

Either there was a build timeout or someone aborted the build.

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2022-09-29T05:21:58.977+0000
Duration: 0 min 10 sec

axw

Nice! LGTM.

apmmachine · 2022-09-29T05:49:47Z

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2022-09-29T05:20:18.193+0000
Duration: 29 min 24 sec

Test stats 🧪

Test	Results
Failed	1
Passed	148
Skipped	0
Total	149

Test errors

Expand to view the tests failures

`TestFleetIntegrationMonitoring – github.com/elastic/apm-server/systemtest`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestFleetIntegrationMonitoring
2022/09/29 05:42:45 Starting container id: 551bc827be4a image: elastic-agent-systemtest:8.6.0-326f84b0-SNAPSHOT
2022/09/29 05:42:46 Waiting for container id 551bc827be4a image: elastic-agent-systemtest:8.6.0-326f84b0-SNAPSHOT
2022/09/29 05:42:50 Container is ready id: 551bc827be4a image: elastic-agent-systemtest:8.6.0-326f84b0-SNAPSHOT
    fleet_test.go:88: 
        	Error Trace:	/var/lib/jenkins/workspace/pm-server_apm-server-mbp_PR-9233/src/github.com/elastic/apm-server/systemtest/fleet_test.go:88
        	Error:      	Not equal: 
        	            	expected: map[string]interface {}{"output":map[string]interface {}{"events":map[string]interface {}{"acked":15, "active":0, "batches":1, "failed":0, "toomany":0, "total":15}, "type":"elasticsearch", "write":map[string]interface {}{}}, "pipeline":map[string]interface {}{"events":map[string]interface {}{"total":15}}}
        	            	actual  : map[string]interface {}{"output":map[string]interface {}{"events":map[string]interface {}{"acked":0, "active":0, "batches":0, "failed":0, "toomany":0, "total":0}, "type":"elasticsearch", "write":map[string]interface {}{}}, "pipeline":map[string]interface {}{"events":map[string]interface {}{"total":0}}}
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -3,8 +3,8 @@
        	            	   (string) (len=6) "events": (map[string]interface {}) (len=6) {
        	            	-   (string) (len=5) "acked": (float64) 15,
        	            	+   (string) (len=5) "acked": (float64) 0,
        	            	    (string) (len=6) "active": (float64) 0,
        	            	-   (string) (len=7) "batches": (float64) 1,
        	            	+   (string) (len=7) "batches": (float64) 0,
        	            	    (string) (len=6) "failed": (float64) 0,
        	            	    (string) (len=7) "toomany": (float64) 0,
        	            	-   (string) (len=5) "total": (float64) 15
        	            	+   (string) (len=5) "total": (float64) 0
        	            	   },
        	            	@@ -16,3 +16,3 @@
        	            	   (string) (len=6) "events": (map[string]interface {}) (len=1) {
        	            	-   (string) (len=5) "total": (float64) 15
        	            	+   (string) (len=5) "total": (float64) 0
        	            	   }
        	Test:       	TestFleetIntegrationMonitoring
    fleet_test.go:107: 
        	Error Trace:	/var/lib/jenkins/workspace/pm-server_apm-server-mbp_PR-9233/src/github.com/elastic/apm-server/systemtest/fleet_test.go:107
        	Error:      	Not equal: 
        	            	expected: map[string]interface {}{"elasticsearch":map[string]interface {}{"bulk_requests":map[string]interface {}{"available":10, "completed":1}}}
        	            	actual  : map[string]interface {}{"elasticsearch":map[string]interface {}{"bulk_requests":map[string]interface {}{"available":10, "completed":0}}}
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -4,3 +4,3 @@
        	            	    (string) (len=9) "available": (float64) 10,
        	            	-   (string) (len=9) "completed": (float64) 1
        	            	+   (string) (len=9) "completed": (float64) 0
        	            	   }
        	Test:       	TestFleetIntegrationMonitoring
    fleet_test.go:179: elastic-agent logs: {"log.level":"info","@timestamp":"2022-09-29T05:42:46.940Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":471},"message":"Starting enrollment to URL: https://fleet-server:8220/","ecs.version":"1.6.0"}
        Successfully enrolled the Elastic Agent.
        {"log.level":"info","@timestamp":"2022-09-29T05:42:47.738Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":271},"message":"Elastic Agent might not be running; unable to trigger restart","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:47.887Z","log.origin":{"file.name":"cmd/run.go","file.line":202},"message":"APM instrumentation disabled","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:47.888Z","log.origin":{"file.name":"application/application.go","file.line":78},"message":"Detecting execution mode","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:47.909Z","log.origin":{"file.name":"application/application.go","file.line":102},"message":"Agent is managed by Fleet","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:47.909Z","log.origin":{"file.name":"capabilities/capabilities.go","file.line":59},"message":"capabilities file not found in /usr/share/elastic-agent/state/capabilities.yml","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:48.255Z","log.logger":"composable.providers.docker","log.origin":{"file.name":"docker/docker.go","file.line":44},"message":"Docker provider skipped, unable to connect: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:48.256Z","log.logger":"api","log.origin":{"file.name":"api/server.go","file.line":68},"message":"Starting stats endpoint","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:48.257Z","log.origin":{"file.name":"application/managed_mode.go","file.line":316},"message":"Agent is starting","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:48.257Z","log.logger":"api","log.origin":{"file.name":"api/server.go","file.line":70},"message":"Metrics endpoint listening on: /usr/share/elastic-agent/state/data/tmp/elastic-agent.sock (configured: unix:///usr/share/elastic-agent/state/data/tmp/elastic-agent.sock)","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:49.706Z","log.origin":{"file.name":"artifact/config.go","file.line":138},"message":"Source URI changed from \"https://artifacts.elastic.co/downloads/\" to \"https://artifacts.elastic.co/downloads/\"","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:49.750Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":48},"message":"New State ID is tQMRG-vl","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:49.750Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":49},"message":"Converging state requires execution of 2 step(s)","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:49.927Z","log.origin":{"file.name":"operation/operator.go","file.line":387},"message":"operation 'operation-install' skipped for apm-server.8.6.0-SNAPSHOT","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:50.347Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2022-09-29T05:42:50Z - message: Application: apm-server--8.6.0-SNAPSHOT[3a04897f-185b-4b6a-948b-dc0eff4b31bc]: State changed to STARTING: Starting - type: 'STATE' - sub_type: 'STARTING'","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:50.752Z","log.origin":{"file.name":"operation/operator.go","file.line":387},"message":"operation 'operation-install' skipped for filebeat.8.6.0-SNAPSHOT","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:50.917Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2022-09-29T05:42:50Z - message: Application: filebeat--8.6.0-SNAPSHOT--36643631373035623733363936343635[3a04897f-185b-4b6a-948b-dc0eff4b31bc]: State changed to STARTING: Starting - type: 'STATE' - sub_type: 'STARTING'","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:51.468Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2022-09-29T05:42:51Z - message: Application: apm-server--8.6.0-SNAPSHOT[3a04897f-185b-4b6a-948b-dc0eff4b31bc]: State changed to RUNNING: Running - type: 'STATE' - sub_type: 'RUNNING'","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:51.494Z","log.origin":{"file.name":"operation/operator.go","file.line":387},"message":"operation 'operation-install' skipped for metricbeat.8.6.0-SNAPSHOT","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:51.782Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2022-09-29T05:42:51Z - message: Application: metricbeat--8.6.0-SNAPSHOT--36643631373035623733363936343635[3a04897f-185b-4b6a-948b-dc0eff4b31bc]: State changed to STARTING: Starting - type: 'STATE' - sub_type: 'STARTING'","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:51.786Z","log.origin":{"file.name":"stateresolver/stateresolver.go","file.line":66},"message":"Updating internal state","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:52.320Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2022-09-29T05:42:52Z - message: Application: filebeat--8.6.0-SNAPSHOT--36643631373035623733363936343635[3a04897f-185b-4b6a-948b-dc0eff4b31bc]: State changed to RUNNING: Running - type: 'STATE' - sub_type: 'RUNNING'","ecs.version":"1.6.0"}
        {"log.level":"info","@timestamp":"2022-09-29T05:42:53.102Z","log.origin":{"file.name":"log/reporter.go","file.line":40},"message":"2022-09-29T05:42:53Z - message: Application: metricbeat--8.6.0-SNAPSHOT--36643631373035623733363936343635[3a04897f-185b-4b6a-948b-dc0eff4b31bc]: State changed to RUNNING: Running - type: 'STATE' - sub_type: 'RUNNING'","ecs.version":"1.6.0"}
    fleet_test.go:181: apm-server logs:
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.417Z","log.origin":{"file.name":"beatcmd/beat.go","file.line":155},"message":"Beat ID: 17e73e93-5583-4171-8a3e-b44f39090e1d","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.418Z","log.origin":{"file.name":"beatcmd/beat.go","file.line":168},"message":"Set gc percentage to: 100","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.419Z","log.logger":"api","log.origin":{"file.name":"api/server.go","file.line":63},"message":"Starting stats endpoint","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.419Z","log.logger":"beat","log.origin":{"file.name":"beatcmd/beat.go","file.line":605},"message":"Beat info","service.name":"apm-server","system_info":{"beat":{"path":{"config":"/usr/share/elastic-agent/data/elastic-agent-2b6cfd/install/apm-server-8.6.0-SNAPSHOT-linux-x86_64","data":"/usr/share/elastic-agent/state/data/run/default/apm-server--8.6.0-SNAPSHOT","home":"/usr/share/elastic-agent/data/elastic-agent-2b6cfd/install/apm-server-8.6.0-SNAPSHOT-linux-x86_64","logs":"/usr/share/elastic-agent/data/elastic-agent-2b6cfd/install/apm-server-8.6.0-SNAPSHOT-linux-x86_64/logs"},"type":"apm-server","uuid":"17e73e93-5583-4171-8a3e-b44f39090e1d"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.419Z","log.logger":"beat","log.origin":{"file.name":"beatcmd/beat.go","file.line":613},"message":"Build info","service.name":"apm-server","system_info":{"build":{"commit":"7942e953084529a0e1ab67a3c91af6f16d298e58","time":"2022-09-29T05:14:46.000Z","version":"8.6.0"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.419Z","log.logger":"beat","log.origin":{"file.name":"beatcmd/beat.go","file.line":616},"message":"Go runtime info","service.name":"apm-server","system_info":{"go":{"os":"linux","arch":"amd64","max_procs":4,"version":"go1.18.6"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.419Z","log.logger":"api","log.origin":{"file.name":"api/server.go","file.line":65},"message":"Metrics endpoint listening on: /usr/share/elastic-agent/state/data/tmp/default/apm-server/apm-server.sock (configured: unix:///usr/share/elastic-agent/state/data/tmp/default/apm-server/apm-server.sock)","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.420Z","log.logger":"beat","log.origin":{"file.name":"beatcmd/beat.go","file.line":620},"message":"Host info","service.name":"apm-server","system_info":{"host":{"architecture":"x86_64","boot_time":"2022-09-29T05:30:57Z","containerized":true,"name":"551bc827be4a","ip":["127.0.0.1/8","172.18.0.7/16"],"kernel_version":"5.4.0-1087-gcp","mac":["02:42:ac:12:00:07"],"os":{"type":"linux","family":"debian","platform":"ubuntu","name":"Ubuntu","version":"20.04.5 LTS (Focal Fossa)","major":20,"minor":4,"patch":5,"codename":"focal"},"timezone":"UTC","timezone_offset_sec":0},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.421Z","log.logger":"beat","log.origin":{"file.name":"beatcmd/beat.go","file.line":649},"message":"Process info","service.name":"apm-server","system_info":{"process":{"capabilities":{"inheritable":null,"permitted":null,"effective":null,"bounding":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"ambient":null},"cwd":"/usr/share/elastic-agent/data/elastic-agent-2b6cfd/install/apm-server-8.6.0-SNAPSHOT-linux-x86_64","exe":"/usr/share/elastic-agent/data/elastic-agent-2b6cfd/install/apm-server-8.6.0-SNAPSHOT-linux-x86_64/apm-server","name":"apm-server","pid":26,"ppid":7,"seccomp":{"mode":"filter","no_new_privs":false},"start_time":"2022-09-29T05:42:49.650Z"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.445Z","log.logger":"esclientleg","log.origin":{"file.name":"eslegclient/connection.go","file.line":108},"message":"elasticsearch url: http://localhost:9200","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.446Z","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":113},"message":"Beat name: 551bc827be4a","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.447Z","log.origin":{"file.name":"beatcmd/beat.go","file.line":397},"message":"apm-server started.","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2022-09-29T05:42:50.447Z","log.logger":"cfgwarn","log.origin":{"file.name":"management/manager.go","file.line":116},"message":"BETA: Fleet management is enabled","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.447Z","log.logger":"centralmgmt.fleet","log.origin":{"file.name":"management/manager.go","file.line":117},"message":"Starting fleet management service","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.447Z","log.logger":"centralmgmt.fleet","log.origin":{"file.name":"management/manager.go","file.line":125},"message":"Ready to receive configuration","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.465Z","log.logger":"beater","log.origin":{"file.name":"beater/beater.go","file.line":1161},"message":"maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.968Z","log.logger":"centralmgmt.fleet","log.origin":{"file.name":"management/manager.go","file.line":162},"message":"Status change to Configuring: Updating configuration","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.970Z","log.logger":"centralmgmt.fleet","log.origin":{"file.name":"management/manager.go","file.line":287},"message":"Applying settings for inputs","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2022-09-29T05:42:50.971Z","log.logger":"cfgwarn","log.origin":{"file.name":"tlscommon/config.go","file.line":102},"message":"DEPRECATED: Treating the CommonName field on X.509 certificates as a host name when no Subject Alternative Names are present is going to be removed. Please update your certificates if needed. Will be removed in version: 8.0.0","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.973Z","log.logger":"config","log.origin":{"file.name":"config/rum.go","file.line":86},"message":"Unable to determine sourcemap storage, sourcemaps will not be applied","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.973Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":142},"message":"Listening on: [::]:8200","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.973Z","log.logger":"beater","log.origin":{"file.name":"apm-server/main.go","file.line":69},"message":"creating transaction metrics aggregation with config: {Interval:1m0s MaxTransactionGroups:10000 HDRHistogramSignificantFigures:2}","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.983Z","log.logger":"beater","log.origin":{"file.name":"apm-server/main.go","file.line":84},"message":"creating service destinations aggregation with config: {Interval:1m0s MaxGroups:10000}","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.983Z","log.logger":"centralmgmt.fleet","log.origin":{"file.name":"management/manager.go","file.line":287},"message":"Applying settings for output","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.987Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path / added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.987Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /config/v1/agents added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.987Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /config/v1/rum/agents added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /intake/v2/rum/events added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /intake/v3/rum/events added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /intake/v2/events added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /v1/traces added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /v1/metrics added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /v1/logs added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"beater","log.origin":{"file.name":"beater/server.go","file.line":193},"message":"Starting apm-server [7942e953084529a0e1ab67a3c91af6f16d298e58 built 2022-09-29 13:14:46 +0800 +0800]. Hit CTRL-C to stop it.","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":86},"message":"RUM endpoints enabled!","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":89},"message":"CORS related setting `apm-server.rum.allow_origins` allows all origins. Consider more restrictive setting for production use.","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.988Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":104},"message":"SSL disabled.","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.989Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request ok","service.name":"apm-server","url.original":"/","http.request.method":"GET","user_agent.original":"Go-http-client/1.1","source.address":"172.18.0.1","http.request.body.bytes":0,"http.request.id":"664792de-b66d-4cef-9c25-6f1ff4d03eb0","event.duration":265468,"http.response.status_code":200,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.999Z","log.logger":"config","log.origin":{"file.name":"config/rum.go","file.line":89},"message":"Falling back to elasticsearch output for sourcemap storage","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:50.999Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request ok","service.name":"apm-server","url.original":"/","http.request.method":"GET","user_agent.original":"apm-agent-go/2.1.0","source.address":"10.11.12.13","http.request.body.bytes":0,"http.request.id":"555b0d4c-9bde-437e-b116-20c15b75b11c","event.duration":520923,"http.response.status_code":200,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.000Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":142},"message":"Listening on: [::]:8200","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.008Z","log.logger":"beater","log.origin":{"file.name":"beater/waitready.go","file.line":40},"message":"blocking ingestion until all preconditions are satisfied","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.018Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request ok","service.name":"apm-server","url.original":"/config/v1/agents?service.name=systemtest_test","http.request.method":"GET","user_agent.original":"apm-agent-go/2.1.0","source.address":"10.11.12.13","http.request.body.bytes":0,"http.request.id":"dd99baab-fd00-46a5-975d-41aa4c17adbd","event.duration":13049343,"http.response.status_code":200,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.022Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request accepted","service.name":"apm-server","url.original":"/intake/v2/events","http.request.method":"POST","user_agent.original":"apm-agent-go/2.1.0","source.address":"10.11.12.13","http.request.id":"8abe6d38-e6c1-4b2a-aa7d-64a446b5e1bb","event.duration":17547356,"http.response.status_code":202,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.026Z","log.logger":"beater","log.origin":{"file.name":"apm-server/main.go","file.line":69},"message":"creating transaction metrics aggregation with config: {Interval:1m0s MaxTransactionGroups:10000 HDRHistogramSignificantFigures:2}","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.035Z","log.logger":"beater","log.origin":{"file.name":"beater/waitready.go","file.line":68},"message":"no longer blocking ingestion as all precondition checks are now satisfied","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.037Z","log.logger":"beater","log.origin":{"file.name":"apm-server/main.go","file.line":84},"message":"creating service destinations aggregation with config: {Interval:1m0s MaxGroups:10000}","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.037Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":110},"message":"Stop listening on: :8200","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.037Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path / added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /config/v1/agents added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /config/v1/rum/agents added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /intake/v2/rum/events added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /intake/v3/rum/events added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /intake/v2/events added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /v1/traces added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /v1/metrics added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"handler","log.origin":{"file.name":"api/mux.go","file.line":133},"message":"Path /v1/logs added to request handler","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"beater","log.origin":{"file.name":"beater/server.go","file.line":193},"message":"Starting apm-server [7942e953084529a0e1ab67a3c91af6f16d298e58 built 2022-09-29 13:14:46 +0800 +0800]. Hit CTRL-C to stop it.","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":86},"message":"RUM endpoints enabled!","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":89},"message":"CORS related setting `apm-server.rum.allow_origins` allows all origins. Consider more restrictive setting for production use.","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.038Z","log.logger":"beater","log.origin":{"file.name":"beater/http.go","file.line":104},"message":"SSL disabled.","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.041Z","log.logger":"beater","log.origin":{"file.name":"beater/server.go","file.line":210},"message":"Server stopped","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.041Z","log.logger":"beater","log.origin":{"file.name":"apm-server/main.go","file.line":219},"message":"transaction metrics aggregation stopped","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.042Z","log.logger":"beater","log.origin":{"file.name":"apm-server/main.go","file.line":219},"message":"service destinations aggregation stopped","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2022-09-29T05:42:51.042Z","log.logger":"beater","log.origin":{"file.name":"beater/beater.go","file.line":368},"message":"context canceled","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.042Z","log.logger":"esclientleg","log.origin":{"file.name":"eslegclient/connection.go","file.line":108},"message":"elasticsearch url: http://elasticsearch:9200","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:51.285Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request ok","service.name":"apm-server","url.original":"/","http.request.method":"GET","user_agent.original":"apm-agent-go/2.0.0 (filebeat)","source.address":"127.0.0.1","http.request.body.bytes":0,"http.request.id":"d4fd93d3-2247-4d9d-bfed-4765d0822870","event.duration":155280,"http.response.status_code":200,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:52.008Z","log.logger":"request","log.origin":{"file.name":"middleware/log_middleware.go","file.line":61},"message":"request ok","service.name":"apm-server","url.original":"/","http.request.method":"GET","user_agent.original":"apm-agent-go/2.0.0 (metricbeat)","source.address":"127.0.0.1","http.request.body.bytes":0,"http.request.id":"ca6ecf58-613f-459d-a879-9c4a403c9011","event.duration":131489,"http.response.status_code":200,"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:52.024Z","log.logger":"publisher_pipeline_output","log.origin":{"file.name":"pipeline/client_worker.go","file.line":139},"message":"Connecting to backoff(elasticsearch(http://elasticsearch:9200))","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:52.030Z","log.logger":"esclientleg","log.origin":{"file.name":"eslegclient/connection.go","file.line":291},"message":"Attempting to connect to Elasticsearch version 8.6.0-SNAPSHOT","service.name":"apm-server","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2022-09-29T05:42:52.030Z","log.logger":"publisher_pipeline_output","log.origin":{"file.name":"pipeline/client_worker.go","file.line":147},"message":"Connection to backoff(elasticsearch(http://elasticsearch:9200)) established","service.name":"apm-server","ecs.version":"1.6.0"}
--- FAIL: TestFleetIntegrationMonitoring (20.03s)

Steps errors

Expand to view the steps failures

`Run Linux tests`

Took 14 min 40 sec . View more details here
Description: ./.ci/scripts/linux-test.sh

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate and publish the docker images.
/test windows : Build & tests on Windows.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

apmmachine · 2022-09-29T05:49:53Z

📚 Go benchmark report

Diff with the main branch

name                                                                                              old time/op    new time/op     delta
pkg:github.com/elastic/apm-server/internal/agentcfg goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/beater/request goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/model/modelindexer goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/processor/stream goos:linux goarch:amd64
BackendProcessor/spans.ndjson-12                                                                     121µs ±10%       96µs ±13%  -20.35%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel2/minimal.ndjson-12                       7.13µs ±14%     6.52µs ± 2%   -8.50%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/optional-timestamps.ndjson-12           1.89µs ± 4%     1.81µs ± 1%   -4.57%  (p=0.032 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/otel-bridge.ndjson-12                   3.98µs ± 2%     3.80µs ± 3%   -4.49%  (p=0.016 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/ratelimit.ndjson-12                     6.70µs ± 1%     6.21µs ± 2%   -7.28%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/span-links.ndjson-12                    1.60µs ± 1%     1.52µs ± 0%   -4.71%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/spans.ndjson-12                         11.5µs ± 1%     10.9µs ± 2%   -5.16%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions-huge_traces.ndjson-12      5.74µs ± 1%     5.47µs ± 1%   -4.79%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions.ndjson-12                  11.4µs ± 0%     10.9µs ± 0%   -4.30%  (p=0.016 n=5+4)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions_spans.ndjson-12            11.4µs ± 0%     10.6µs ± 1%   -6.54%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions_spans_rum.ndjson-12        2.07µs ± 1%     1.98µs ± 2%   -4.41%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions_spans_rum_2.ndjson-12      2.00µs ± 1%     1.90µs ± 0%   -5.17%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/unknown-span-type.ndjson-12             7.49µs ± 1%     7.10µs ± 1%   -5.32%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors.ndjson-12                      7.59µs ± 1%     6.87µs ± 2%   -9.45%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors_2.ndjson-12                    7.07µs ± 1%     6.49µs ± 4%   -8.18%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors_rum.ndjson-12                  2.03µs ± 2%     1.92µs ± 1%   -5.05%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors_transaction_id.ndjson-12       5.61µs ± 1%     5.36µs ± 1%   -4.41%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/events.ndjson-12                      13.6µs ± 1%     13.0µs ± 1%   -4.96%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/heavy.ndjson-12                        529µs ± 2%      494µs ± 3%   -6.57%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-event-type.ndjson-12           813ns ± 1%      792ns ± 1%   -2.61%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-event.ndjson-12               3.46µs ± 1%     3.29µs ± 1%   -5.02%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-json-event.ndjson-12          1.11µs ± 2%     1.07µs ± 1%   -3.98%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-json-metadata.ndjson-12       1.95µs ± 0%     1.86µs ± 0%   -4.56%  (p=0.016 n=5+4)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-metadata-2.ndjson-12           501ns ± 1%      488ns ± 1%   -2.52%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-metadata.ndjson-12             508ns ± 1%      492ns ± 1%   -3.08%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/logs.ndjson-12                        1.95µs ± 1%     1.83µs ± 3%   -5.88%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/metadata-null-values.ndjson-12         787ns ± 1%      765ns ± 1%   -2.90%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/metadata.ndjson-12                    1.29µs ± 2%     1.25µs ± 2%   -3.23%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/metricsets.ndjson-12                  4.54µs ± 1%     4.36µs ± 1%   -3.80%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/minimal-service.ndjson-12              991ns ± 1%      955ns ± 2%   -3.60%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/minimal.ndjson-12                     2.02µs ± 2%     1.94µs ± 1%   -3.64%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/optional-timestamps.ndjson-12         1.50µs ± 2%     1.43µs ± 2%   -5.04%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/otel-bridge.ndjson-12                 3.25µs ± 1%     3.12µs ± 3%   -3.96%  (p=0.016 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/span-links.ndjson-12                  1.20µs ± 1%     1.17µs ± 2%   -3.02%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/spans.ndjson-12                       9.61µs ± 1%     9.35µs ± 1%   -2.68%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions-huge_traces.ndjson-12    4.76µs ± 3%     4.61µs ± 2%   -3.17%  (p=0.016 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions.ndjson-12                9.61µs ± 2%     9.26µs ± 2%   -3.67%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions_spans.ndjson-12          9.59µs ± 1%     9.26µs ± 3%   -3.43%  (p=0.032 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions_spans_rum.ndjson-12      1.66µs ± 1%     1.58µs ± 1%   -4.51%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions_spans_rum_2.ndjson-12    1.56µs ± 1%     1.52µs ± 2%   -2.49%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/unknown-span-type.ndjson-12           6.32µs ± 2%     6.08µs ± 1%   -3.68%  (p=0.008 n=5+5)
ReadBatch/heavy.ndjson-12                                                                           3.22ms ±16%     3.86ms ± 5%  +19.65%  (p=0.032 n=5+5)
ReadBatch/invalid-json-event.ndjson-12                                                              10.9µs ±25%     15.9µs ±13%  +46.69%  (p=0.008 n=5+5)
ReadBatch/invalid-json-metadata.ndjson-12                                                           44.1µs ±14%     34.5µs ±15%  -21.89%  (p=0.016 n=5+5)
ReadBatch/logs.ndjson-12                                                                            32.5µs ± 6%     27.5µs ±28%  -15.30%  (p=0.032 n=5+5)
pkg:github.com/elastic/apm-server/internal/publish goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/aggregation/spanmetrics goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/aggregation/txmetrics goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/sampling goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/sampling/eventstorage goos:linux goarch:amd64
ReadEvents/json_codec/10_events-12                                                                   167µs ±18%      132µs ± 8%  -21.00%  (p=0.008 n=5+5)
IsTraceSampled/unknown-12                                                                            375ns ± 1%      369ns ± 0%   -1.66%  (p=0.008 n=5+5)

name                                                                                              old alloc/op   new alloc/op    delta
pkg:github.com/elastic/apm-server/internal/agentcfg goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/beater/request goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/model/modelindexer goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/processor/stream goos:linux goarch:amd64
BackendProcessor/events.ndjson-12                                                                   40.1kB ± 1%     39.6kB ± 1%   -1.08%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel2/span-links.ndjson-12                    5.21kB ± 1%     5.12kB ± 1%   -1.75%  (p=0.032 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/metadata.ndjson-12                      5.56kB ± 0%     5.52kB ± 1%   -0.82%  (p=0.024 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors.ndjson-12                      22.4kB ± 0%     22.3kB ± 0%   -0.45%  (p=0.032 n=5+5)
ReadBatch/transactions.ndjson-12                                                                    25.2kB ± 0%     25.2kB ± 0%   +0.06%  (p=0.016 n=5+5)
pkg:github.com/elastic/apm-server/internal/publish goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/aggregation/spanmetrics goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/aggregation/txmetrics goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/sampling goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/sampling/eventstorage goos:linux goarch:amd64
ReadEvents/json_codec_big_tx/100_events-12                                                          1.03MB ± 0%     1.03MB ± 0%   -0.03%  (p=0.040 n=5+5)
ReadEvents/nop_codec/10_events-12                                                                   25.7kB ± 0%     25.7kB ± 0%   -0.04%  (p=0.016 n=5+4)

name                                                                                              old allocs/op  new allocs/op   delta
pkg:github.com/elastic/apm-server/internal/agentcfg goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/beater/request goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/model/modelindexer goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/internal/processor/stream goos:linux goarch:amd64
BackendProcessorParallel/BenchmarkBackendProcessorParallel4/heavy.ndjson-12                          22.3k ± 0%      22.3k ± 0%   -0.01%  (p=0.000 n=5+4)
pkg:github.com/elastic/apm-server/internal/publish goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/aggregation/spanmetrics goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/aggregation/txmetrics goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/sampling goos:linux goarch:amd64
pkg:github.com/elastic/apm-server/x-pack/apm-server/sampling/eventstorage goos:linux goarch:amd64

name                                                                                              old speed      new speed       delta
pkg:github.com/elastic/apm-server/internal/processor/stream goos:linux goarch:amd64
BackendProcessor/spans.ndjson-12                                                                  66.6MB/s ±10%   84.0MB/s ±14%  +26.04%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel2/minimal.ndjson-12                      145MB/s ±13%    158MB/s ± 2%   +8.74%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/optional-timestamps.ndjson-12          543MB/s ± 4%    569MB/s ± 1%   +4.70%  (p=0.032 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/otel-bridge.ndjson-12                  473MB/s ± 2%    495MB/s ± 3%   +4.72%  (p=0.016 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/ratelimit.ndjson-12                    629MB/s ± 1%    678MB/s ± 2%   +7.88%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/span-links.ndjson-12                   427MB/s ± 1%    448MB/s ± 0%   +4.93%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/spans.ndjson-12                        700MB/s ± 1%    738MB/s ± 2%   +5.45%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions-huge_traces.ndjson-12     552MB/s ± 1%    580MB/s ± 1%   +5.03%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions.ndjson-12                 495MB/s ± 0%    517MB/s ± 0%   +4.50%  (p=0.016 n=5+4)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions_spans.ndjson-12           511MB/s ± 0%    547MB/s ± 1%   +7.00%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions_spans_rum.ndjson-12       557MB/s ± 1%    583MB/s ± 2%   +4.63%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/transactions_spans_rum_2.ndjson-12     558MB/s ± 1%    589MB/s ± 1%   +5.44%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel8/unknown-span-type.ndjson-12            441MB/s ± 1%    466MB/s ± 1%   +5.62%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors.ndjson-12                     836MB/s ± 1%    923MB/s ± 2%  +10.45%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors_2.ndjson-12                   667MB/s ± 1%    727MB/s ± 3%   +8.99%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors_rum.ndjson-12                 936MB/s ± 2%    986MB/s ± 1%   +5.30%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/errors_transaction_id.ndjson-12      682MB/s ± 1%    713MB/s ± 1%   +4.62%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/events.ndjson-12                     545MB/s ± 1%    573MB/s ± 1%   +5.21%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/heavy.ndjson-12                      755MB/s ± 2%    808MB/s ± 3%   +7.05%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-event-type.ndjson-12         481MB/s ± 1%    494MB/s ± 1%   +2.68%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-event.ndjson-12              221MB/s ± 1%    233MB/s ± 1%   +5.27%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-json-event.ndjson-12         528MB/s ± 2%    550MB/s ± 1%   +4.12%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-json-metadata.ndjson-12      229MB/s ± 0%    240MB/s ± 1%   +4.78%  (p=0.016 n=5+4)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-metadata-2.ndjson-12         870MB/s ± 1%    893MB/s ± 1%   +2.59%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/invalid-metadata.ndjson-12           878MB/s ± 1%    906MB/s ± 1%   +3.17%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/logs.ndjson-12                       681MB/s ± 1%    724MB/s ± 3%   +6.29%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/metadata-null-values.ndjson-12       668MB/s ± 1%    688MB/s ± 1%   +2.98%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/metadata.ndjson-12                   962MB/s ± 1%    994MB/s ± 2%   +3.37%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/metricsets.ndjson-12                 561MB/s ± 1%    583MB/s ± 1%   +3.95%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/minimal-service.ndjson-12            429MB/s ± 1%    445MB/s ± 2%   +3.75%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/minimal.ndjson-12                    511MB/s ± 2%    530MB/s ± 1%   +3.78%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/optional-timestamps.ndjson-12        683MB/s ± 2%    719MB/s ± 2%   +5.30%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/otel-bridge.ndjson-12                578MB/s ± 1%    602MB/s ± 3%   +4.14%  (p=0.016 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/span-links.ndjson-12                 566MB/s ± 1%    584MB/s ± 2%   +3.15%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/spans.ndjson-12                      836MB/s ± 1%    859MB/s ± 1%   +2.76%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions-huge_traces.ndjson-12   666MB/s ± 3%    688MB/s ± 2%   +3.26%  (p=0.016 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions.ndjson-12               588MB/s ± 2%    610MB/s ± 2%   +3.82%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions_spans.ndjson-12         606MB/s ± 1%    628MB/s ± 3%   +3.58%  (p=0.032 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions_spans_rum.ndjson-12     698MB/s ± 1%    731MB/s ± 1%   +4.73%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/transactions_spans_rum_2.ndjson-12   716MB/s ± 1%    734MB/s ± 2%   +2.56%  (p=0.008 n=5+5)
BackendProcessorParallel/BenchmarkBackendProcessorParallel200/unknown-span-type.ndjson-12          523MB/s ± 2%    543MB/s ± 1%   +3.81%  (p=0.008 n=5+5)
ReadBatch/heavy.ndjson-12                                                                          125MB/s ±18%    104MB/s ± 5%  -17.32%  (p=0.032 n=5+5)
ReadBatch/invalid-json-event.ndjson-12                                                            56.4MB/s ±25%   37.2MB/s ±12%  -34.09%  (p=0.008 n=5+5)
ReadBatch/invalid-json-metadata.ndjson-12                                                         10.2MB/s ±16%   13.1MB/s ±15%  +27.93%  (p=0.016 n=5+5)
ReadBatch/logs.ndjson-12                                                                          40.9MB/s ± 6%   49.5MB/s ±34%  +21.22%  (p=0.032 n=5+5)

report generated with https://pkg.go.dev/golang.org/x/perf/cmd/benchstat

apmmachine · 2022-09-29T05:51:06Z

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2022-09-29T05:22:35.160+0000
Duration: 28 min 28 sec

…ored * upstream/main: smoke: Remove usage of artifacts API (elastic#9233) Update to elastic/beats@77e4e30df6e2 (elastic#9227) Enable synthetic source for metrics data streams (elastic#9215) testing/rally: add force-merge operation (elastic#9226) Make ecs.version a constant_keyword field (elastic#9208)

marclop added test backport-skip Skip notification from the automated backport with mergify labels Sep 29, 2022

marclop requested a review from a team September 29, 2022 05:20

marclop self-assigned this Sep 29, 2022

marclop mentioned this pull request Sep 29, 2022

ci: run smoke tests in parallel even for different versions #9224

Merged

axw approved these changes Sep 29, 2022

View reviewed changes

marclop enabled auto-merge (squash) September 29, 2022 05:37

marclop disabled auto-merge September 29, 2022 05:47

marclop merged commit 5bdfce9 into elastic:main Sep 29, 2022

marclop deleted the f/smoke-drop-usage-of-artifacts-api branch September 29, 2022 05:48

v1v mentioned this pull request Sep 29, 2022

smoke-test: check if artifacts api is available #9225

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

smoke: Remove usage of artifacts API #9233

smoke: Remove usage of artifacts API #9233

marclop commented Sep 29, 2022 •

edited

Loading

apmmachine commented Sep 29, 2022

Build stats

axw left a comment

apmmachine commented Sep 29, 2022

Build stats

Test stats 🧪

`TestFleetIntegrationMonitoring – github.com/elastic/apm-server/systemtest`

`Run Linux tests`

apmmachine commented Sep 29, 2022

apmmachine commented Sep 29, 2022

Build stats

smoke: Remove usage of artifacts API #9233

smoke: Remove usage of artifacts API #9233

Conversation

marclop commented Sep 29, 2022 • edited Loading

Motivation/summary

Checklist

How to test these changes

Related issues

apmmachine commented Sep 29, 2022

❕ Build Aborted

Build stats

axw left a comment

Choose a reason for hiding this comment

apmmachine commented Sep 29, 2022

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

TestFleetIntegrationMonitoring – github.com/elastic/apm-server/systemtest

Steps errors

Run Linux tests

🤖 GitHub comments

apmmachine commented Sep 29, 2022

📚 Go benchmark report

apmmachine commented Sep 29, 2022

💚 Build Succeeded

Build stats

marclop commented Sep 29, 2022 •

edited

Loading

`TestFleetIntegrationMonitoring – github.com/elastic/apm-server/systemtest`

`Run Linux tests`