Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--remote_download_toplevel --nozip_undeclared_test_outputs does not download any undeclared test outputs for passing tests #17884

Closed
VarunKoyyalagunta opened this issue Mar 25, 2023 · 6 comments
Assignees
Labels
P2 We'll consider working on this in future. (Assignee optional) team-Remote-Exec Issues and PRs for the Execution (Remote) team type: bug

Comments

@VarunKoyyalagunta
Copy link

Description of the bug:

Prior to upgrading to bazel 6.0.0, on a setup with remote execution, with bazel test --remote_download_toplevel --nozip_undeclared_test_outputs I'd see test.outputs populated with files.
On bazel 6.0.0, test.outputs is always empty on passing tests.

What's the simplest, easiest way to reproduce this bug? Please provide a minimal example if possible.

With remote execution, run bazel test --remote_download_toplevel --nozip_undeclared_test_outputs. Observe that test.outputs is empty on passing tests.

Which operating system are you running Bazel on?

Linux

What is the output of bazel info release?

release 6.0.0

If bazel info release returns development version or (@non-git), tell us how you built Bazel.

No response

What's the output of git remote get-url origin; git rev-parse master; git rev-parse HEAD ?

No response

Have you found anything relevant by searching the web?

No response

Any other information, logs, or outputs that you want to share?

If I remove --nozip_undeclared_test_outputs, I see test.outputs/outputs.zip on passing tests too
If I remove --remote_download_toplevel, I see the desired files in test.outputs/* on passing tests too

Adding --experimental_remote_download_regex=".*" didn't help.

@tjgq
Copy link
Contributor

tjgq commented Mar 29, 2023

Note to future self: the minimal repro for #17911 is also applicable to this issue.

@joeleba joeleba added P2 We'll consider working on this in future. (Assignee optional) and removed untriaged labels Apr 4, 2023
copybara-service bot pushed a commit that referenced this issue May 25, 2023
The undeclared outputs can be produced in zipped or unzipped form, depending on the value of --zip_undeclared_test_outputs; test-setup.sh is responsible for the zipping. To simplify the code, the TestRunnerAction is declared as unconditionally producing an output directory, which will either contain a single zip file, a bunch of unzipped files, or be empty if no undeclared outputs were produced.

This change is required to make it possible to download the undeclared test outputs in unzipped form when building without the bytes.

Related to #17884.

PiperOrigin-RevId: 535188928
Change-Id: I94e72fe8840fa2274b66a2c8463cf90b4533c3a6
fweikert pushed a commit to fweikert/bazel that referenced this issue May 25, 2023
The undeclared outputs can be produced in zipped or unzipped form, depending on the value of --zip_undeclared_test_outputs; test-setup.sh is responsible for the zipping. To simplify the code, the TestRunnerAction is declared as unconditionally producing an output directory, which will either contain a single zip file, a bunch of unzipped files, or be empty if no undeclared outputs were produced.

This change is required to make it possible to download the undeclared test outputs in unzipped form when building without the bytes.

Related to bazelbuild#17884.

PiperOrigin-RevId: 535188928
Change-Id: I94e72fe8840fa2274b66a2c8463cf90b4533c3a6
@brentleyjones
Copy link
Contributor

@tjgq My usual question 😅 is this cherry-pickable?

@tjgq
Copy link
Contributor

tjgq commented May 31, 2023

I don't think it's going to be possible, sorry :( there are way too many other changes that this one depends on.

@brentleyjones
Copy link
Contributor

That is unfortunate, as it was working in 5.x, but broke in 6.x, and will only work again in 7.0 ☹️.

@coeuvre
Copy link
Member

coeuvre commented Jul 5, 2023

I will try to work out a dedicated fix for 6.3.

@coeuvre
Copy link
Member

coeuvre commented Jul 5, 2023

@bazel-io fork 6.3.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P2 We'll consider working on this in future. (Assignee optional) team-Remote-Exec Issues and PRs for the Execution (Remote) team type: bug
Projects
None yet
Development

No branches or pull requests

7 participants