Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

intTests/runtests.sh needs to be more clear about whether any tests failed #603

Closed
brianhuffman opened this issue Dec 4, 2019 · 1 comment
Closed

intTests/runtests.sh needs to be more clear about whether any tests failed #603

brianhuffman opened this issue Dec 4, 2019 · 1 comment
Labels
tooling: test infrastructure Issues involving test infrastructure or test execution, or making SAW more testable

Comments

@brianhuffman
Copy link
Contributor

When running the saw-script integration tests with the intTests/runtests.sh script, it prints only the message tests completed when it is finished running. The message is the same whether or not any individual tests have failed, which makes it easy to miss one or more test failures.

The cryptol test runner prints a summary when it's done, so you can quickly learn whether or not there were any failures, without having to look anywhere else.

         Test Cases    Total
 Passed  168           168
 Failed  0             0
 Total   168           168

We should do something similar for the saw-script tests.
@brianhuffman brianhuffman added the tooling: test infrastructure Issues involving test infrastructure or test execution, or making SAW more testable label Dec 4, 2019
@brianhuffman brianhuffman mentioned this issue Dec 4, 2019
Closed
@chameco chameco mentioned this issue Dec 6, 2019
Merged
@brianhuffman
Copy link
Contributor Author

Fixed by #605.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
tooling: test infrastructure Issues involving test infrastructure or test execution, or making SAW more testable
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@brianhuffman