[exporter/loadbalancing] Flaky Test - TestRollingUpdatesWhenConsumeLogs

[djaglowski]

Observed here: https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7802139871?check_suite_focus=true#step:7:2604

trace_exporter_test.go:569: 
        	Error Trace:	D:\a\opentelemetry-collector-contrib\opentelemetry-collector-contrib\exporter\loadbalancingexporter\trace_exporter_test.go:569
        	Error:      	"0" is not greater than "0"
        	Test:       	TestRollingUpdatesWhenConsumeTraces
--- FAIL: TestRollingUpdatesWhenConsumeTraces (0.05s)
FAIL
FAIL	github.com/open-telemetry/opentelemetry-collector-contrib/exporter/loadbalancingexporter	0.306s
FAIL
mingw32-make[2]: *** [../../Makefile.Common:56: test] Error 1

[BinaryFissionGames]

May or may not be related to this specific issue, but another flake on the same test: https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7749964411?check_suite_focus=true#step:7:2794

=== RUN   TestRollingUpdatesWhenConsumeLogs
    log_exporter_test.go:468: 
        	Error Trace:	D:\a\opentelemetry-collector-contrib\opentelemetry-collector-contrib\exporter\loadbalancingexporter\log_exporter_test.go:468
        	Error:      	"0" is not greater than "0"
        	Test:       	TestRollingUpdatesWhenConsumeLogs
--- FAIL: TestRollingUpdatesWhenConsumeLogs (0.05s)

[djaglowski]

Again here: https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7777139651?check_suite_focus=true#step:7:2901

[djaglowski]

Here too: https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7787492747?check_suite_focus=true#step:7:2962

[djaglowski]

Escalating this to a p2 due to #13220

[djaglowski]

Related failure on TestRollingUpdatesWhenConsumeTraces: https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7787995852?check_suite_focus=true#step:7:2607

[dmitryax]

ANother instance https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7800282398?check_suite_focus=true

[bogdandrutu]

The initial problem (race condition) was fixed before @djaglowski disabled the test :)) #13257

Lucky the test is still flaky for a different reason, see https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7802139871?check_suite_focus=true

@djaglowski can you update the issue please ?

[djaglowski]

Issue updated.

[dmitryax]

@bogdandrutu looks like it's still happening https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7814063100?check_suite_focus=true

[djaglowski]

A couple more times:
https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7816211433?check_suite_focus=true
https://github.com/open-telemetry/opentelemetry-collector-contrib/runs/7819464925?check_suite_focus=true#step:7:2597

[bogdandrutu]

All of them are for TestRollingUpdatesWhenConsumeTraces not for TestRollingUpdatesWhenConsumeLogs. Looks like a problem on the Traces.

[dmitryax]

Right. I created another issue for traces #13331