Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make tests almost entirely quiet #3725

Merged
merged 21 commits into from
Dec 13, 2023

Conversation

IanButterworth
Copy link
Member

@IanButterworth IanButterworth commented Dec 10, 2023

Best I can do is only this leaking.

Username for 'https://github.com/': Username for 'https://github.com/':

To do better than that we would need to reduce test coverage, or fix git cli https auth on CI, which seems difficult to figure out.

Otherwise everything is now piped into the Pkg.log which is uploaded as matrix-specific artifacts here and similar on buildkite.

@IanButterworth IanButterworth requested a review from a team as a code owner December 10, 2023 03:10
@DilumAluthge DilumAluthge changed the title Make tests quiet again Make tests almost entirely quite Dec 12, 2023
Pkg.rm(TEST_PKG.name)
end
if (Base.get_bool_env("JULIA_PKG_USE_CLI_GIT", false) == false) && !Sys.iswindows()
# TODO: fix. On GH windows runners cli git will prompt for credentials and hang.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we do a @test_skip or something? Or a @test ... skip=Sys.iswindows()?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we skip testsets like that? That's what would be needed here

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bump

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, hmmm, skip the whole testset? I don't think that's possible. So we're probably stuck with the existing approach.

@DilumAluthge
Copy link
Member

DilumAluthge commented Dec 12, 2023

Any idea why macOS CI is failing?

@IanButterworth IanButterworth changed the title Make tests almost entirely quite Make tests almost entirely quiet Dec 12, 2023
@IanButterworth
Copy link
Member Author

One solid failure on MacOS is JuliaLang/julia#52458

The other is flaky git for unknown reasons. Maybe a libgit2 issue.. I don't think anyone has reported it in the wild

@IanButterworth IanButterworth merged commit 07de132 into JuliaLang:master Dec 13, 2023
11 of 13 checks passed
@IanButterworth IanButterworth deleted the ib/quiet_tests branch December 13, 2023 16:45
KristofferC pushed a commit that referenced this pull request May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants