Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

age: skip flaky plugin test #265753

Merged
merged 1 commit into from
Nov 8, 2023
Merged

Conversation

YorikSar
Copy link
Contributor

@YorikSar YorikSar commented Nov 5, 2023

Description of changes

See issue in upstream FiloSottile/age#517.
age fails this test on both x86_64 and aarch64, but sometimes it doesn't.
Disable this test until the upstream issue is resolved.

CC @someplaceguy and @ctheune who've been active in the upstream issue

ZHF: #265948

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 23.11 Release Notes (or backporting 23.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

@someplaceguy
Copy link
Contributor

Unfortunately this test also fails on Linux sometimes, not just Darwin...

Comment on lines 57 to 59
preCheck = lib.optionalString stdenv.isDarwin ''
buildFlagsArray+=("-skip" "TestScript/plugin")
'';
Copy link

@ghost ghost Nov 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
preCheck = lib.optionalString stdenv.isDarwin ''
buildFlagsArray+=("-skip" "TestScript/plugin")
'';
checkFlags = lib.optionals stdenv.isDarwin [
"-skip" "TestScript/plugin"
];

i think using checkFlags here works.

See issue in upstream FiloSottile/age#517.
age sometimes fails this test, but sometimes it doesn't.
Disable this test until the upstream issue is resolved.
@YorikSar
Copy link
Contributor Author

YorikSar commented Nov 6, 2023

@someplaceguy @robert-manchester Good points, thanks. Updated to unconditionally skip with checkFlags.

@delroth delroth added the 12.approvals: 1 This PR was reviewed and approved by one reputable person label Nov 6, 2023
@someplaceguy
Copy link
Contributor

I also approve.

@YorikSar YorikSar added the 0.kind: ZHF Fixes Fixes during the Zero Hydra Failures (ZHF) campaign label Nov 7, 2023
@pbsds pbsds merged commit 0ecb27f into NixOS:master Nov 8, 2023
24 of 25 checks passed
@YorikSar YorikSar deleted the age-disable-flaky-test branch November 8, 2023 23:30
@ctheune
Copy link
Contributor

ctheune commented Nov 9, 2023

Sounds reasonable!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.kind: ZHF Fixes Fixes during the Zero Hydra Failures (ZHF) campaign 10.rebuild-darwin: 1-10 10.rebuild-linux: 1-10 12.approvals: 1 This PR was reviewed and approved by one reputable person
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants