Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

alr test only considers failures on the last test step to be failures. #1806

Open
pyjarrett opened this issue Dec 16, 2024 · 0 comments · May be fixed by #1841
Open

alr test only considers failures on the last test step to be failures. #1806

pyjarrett opened this issue Dec 16, 2024 · 0 comments · May be fixed by #1841
Labels
type: bug Something isn't working
Milestone

Comments

@pyjarrett
Copy link
Contributor

Describe the bug

alr test only considers failures on the last test step to be failures.

To Reproduce

Create two different test steps:

[[actions.'case(os)'.linux]]
type = "test"
command = ["ls", "nonexistent"]  # or any command which returns a non-zero exit code
[[actions.'case(os)'.linux]]
type = "test"
command = ["ls"]

Run tests:

 $ alr test
ⓘ Testing local crate: raffle=0.1.0-dev
✓ Test ended successfully.
ⓘ Check log at /home/paul/dev/ada/raffle/alire/alr_test_local.log

Expected Behavior

I should get the same output as when I swap the order to the two commands, with the failing command last:

ⓘ Testing local crate: raffle=0.1.0-dev
error: Local test of raffle=0.1.0-dev failed:
error:    Check alire/alr_test_local.log for details.

alr version

 $ alr version
APPLICATION
alr version:               2.0.2+9b80158
libalire version:          2.0.2+9b80158
compilation date:          2024-10-09 16:58:27
compiled with version:     14.2.0

CONFIGURATION
settings folder:           /home/paul/.config/alire
cache folder:              /home/paul/.local/share/alire
vault folder:              /home/paul/.local/share/alire/releases
build folder:              /home/paul/.local/share/alire/builds
temp folder:               /run/user/1000
force flag:                FALSE
non-interactive flag:      FALSE
community index branch:    stable-1.3.0
compatible index versions: ^1.1 & <=1.3.0
indexes folder:            /home/paul/.config/alire/indexes
indexes metadata:          OK
index #1:                  (community) git+https://github.com/alire-project/alire-index#stable-1.3.0
toolchain folder:          /home/paul/.local/share/alire/toolchains
toolchain assistant:       disabled
tool #1 gnat:              gnat_native=14.2.1
tool #2 gprbuild:          gprbuild=22.0.1
system package manager:    /usr/bin/apt
distro detection disabled: FALSE

WORKSPACE
root status:               VALID
root release:              raffle=0.1.0-dev
root load error:           none
root folder:               /home/paul/dev/ada/raffle
current folder:            /home/paul/dev/ada/raffle

SYSTEM
distribution:              DEBIAN
host-arch:                 X86_64
os:                        LINUX
target:                    NATIVE
toolchain:                 USER
word-size:                 BITS_64
@mosteo mosteo added the type: bug Something isn't working label Dec 17, 2024
@mosteo mosteo added this to the 2.0.3 milestone Dec 17, 2024
@mosteo mosteo linked a pull request Feb 8, 2025 that will close this issue
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants