Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get TestSet kwargs working #92

Merged
merged 4 commits into from
Apr 14, 2023
Merged

Conversation

mmiller-max
Copy link
Member

First commit fixes an issue where all errors were being hidden when finish was being applied to display the results.
Second commit enables showtime and verbose kwargs to be used in package tests and the displayed output (in display_reporting_testset) updated to ensure correct test timings are displayed and that the kwargs have the intended effect.

Closes #90 .

@mmiller-max mmiller-max requested a review from oxinabox April 7, 2023 17:32
@codecov
Copy link

codecov bot commented Apr 7, 2023

Codecov Report

Merging #92 (b1b3213) into master (8ba6874) will decrease coverage by 0.11%.
The diff coverage is 93.75%.

@@            Coverage Diff             @@
##           master      #92      +/-   ##
==========================================
- Coverage   96.24%   96.14%   -0.11%     
==========================================
  Files           7        7              
  Lines         533      545      +12     
==========================================
+ Hits          513      524      +11     
- Misses         20       21       +1     
Impacted Files Coverage Δ
src/testsets.jl 98.31% <93.75%> (-0.75%) ⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

for r in ts_default.results
r isa AbstractTestSet && finish(r)
end
catch err
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should the try-catch be inside the for loop?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Although that would display more results, it's not how Pkg.test would display the results (that is if first testset of a package fails then the second one wouldn't be displayed as an error is thrown when the first testset finishes. So will keep it as is for now

Copy link
Member

@oxinabox oxinabox left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

some minor points.
Merge when happy

src/testsets.jl Outdated Show resolved Hide resolved
src/testsets.jl Outdated Show resolved Hide resolved
Copy link
Member

@oxinabox oxinabox left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mmiller-max mmiller-max merged commit b2ebdda into master Apr 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

TestReports does not seem to support verbose=true option for @testset
2 participants