Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

parallel/test-runner-reporters is flaking #46747

Closed
joyeecheung opened this issue Feb 20, 2023 · 2 comments · Fixed by #46737
Closed

parallel/test-runner-reporters is flaking #46747

joyeecheung opened this issue Feb 20, 2023 · 2 comments · Fixed by #46737
Labels
flaky-test Issues and PRs related to the tests with unstable failures on the CI. test_runner Issues and PRs related to the test runner subsystem. test Issues and PRs related to the tests.

Comments

@joyeecheung
Copy link
Member

From nodejs/reliability#501 it's failing 15 PRs out of the last 100 CI runs.

Reason parallel/test-runner-reporters
Type JS_TEST_FAILURE
Failed PR 15 (#46600, #46547, #46725, #45841, #46721, #46735, #46509, #46387, #46723, #46616, #46737, #45258, #46577, #46736, #46738)
Appeared test-osuosl-rhel8-ppc64_le-2, test-osuosl-rhel8-ppc64_le-3, test-digitalocean-freebsd12-x64-1, test-osuosl-rhel8-ppc64_le-4, test-ibm-rhel8-s390x-4, test-rackspace-win2012r2_vs2017-x64-4, test-rackspace-win2012r2_vs2019-x64-1, test-rackspace-win2012r2_vs2015-x64-2, test-rackspace-win2012r2_vs2013-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/49683/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49750/
Example 
not ok 2463 parallel/test-runner-reporters
  ---
  duration_ms: 3.288
  severity: fail
  exitcode: 1
  stack: |-
    TAP version 13
    # Subtest: node:test reporters
        # Subtest: should default to outputing TAP to stdout
        ok 1 - should default to outputing TAP to stdout
          ---
          duration_ms: 2885.486488
          ...
@joyeecheung joyeecheung added test Issues and PRs related to the tests. flaky-test Issues and PRs related to the tests with unstable failures on the CI. test_runner Issues and PRs related to the test runner subsystem. labels Feb 20, 2023
@joyeecheung
Copy link
Member Author

cc @nodejs/test_runner

@MoLow
Copy link
Member

MoLow commented Feb 21, 2023

working on resolving this. see a discussion regarding this fluke: #46737 (comment)

@MoLow MoLow mentioned this issue Feb 21, 2023
Merged
@RafaelGSS RafaelGSS mentioned this issue Feb 21, 2023
Merged
@MoLow MoLow closed this as completed in ce49f79 Feb 21, 2023
MoLow added a commit that referenced this issue Feb 21, 2023
@MoLow
test_runner: bootstrap reporters before running tests
b6f5a67 
PR-URL: #46737
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
MoLow added a commit to MoLow/node that referenced this issue Feb 25, 2023
@MoLow
test_runner: bootstrap reporters before running tests
5025bb2 
PR-URL: nodejs#46737
Fixes: nodejs#46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
MoLow added a commit to MoLow/node that referenced this issue Feb 25, 2023
@MoLow
test_runner: bootstrap reporters before running tests
9879adc 
PR-URL: nodejs#46737
Fixes: nodejs#46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
MoLow added a commit to MoLow/node that referenced this issue Feb 25, 2023
@MoLow
test_runner: bootstrap reporters before running tests
69100c9 
PR-URL: nodejs#46737
Fixes: nodejs#46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
juanarbol pushed a commit that referenced this issue Mar 3, 2023
@MoLow @juanarbol
test_runner: bootstrap reporters before running tests
faedcde 
PR-URL: #46737
Backport-PR-URL: #46839
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
juanarbol pushed a commit that referenced this issue Mar 5, 2023
@MoLow @juanarbol
test_runner: bootstrap reporters before running tests
28a1317 
PR-URL: #46737
Backport-PR-URL: #46839
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
targos pushed a commit that referenced this issue Mar 13, 2023
@MoLow @targos
test_runner: bootstrap reporters before running tests
3641388 
PR-URL: #46737
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
targos pushed a commit that referenced this issue Mar 14, 2023
@MoLow @targos
test_runner: bootstrap reporters before running tests
6d32a16 
PR-URL: #46737
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
flaky-test Issues and PRs related to the tests with unstable failures on the CI. test_runner Issues and PRs related to the test runner subsystem. test Issues and PRs related to the tests.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

test_runner: bootstrap reporters before running tests MoLow/node
2 participants
@joyeecheung @MoLow