-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Simplify testing suite #509
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## dev #509 +/- ##
==========================================
+ Coverage 79.53% 84.90% +5.37%
==========================================
Files 48 48
Lines 1412 1398 -14
==========================================
+ Hits 1123 1187 +64
+ Misses 289 211 -78
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good.
My only question is what is the case where the testing files get changed / need to be reuploaded to DANDI? Will that be done manually now since the update-testing-files.yml
workflow was removed?
While we once had aspirations for it to be all automated, the reality is that process will continue as it always has - manually Manually create a specific (usually old) environment and run some code that only works in that specific old environment in order to create the 'bad' example file for testing But even that should really just be for new 'bad' examples - the previous ones can just be downloaded from DANDI and shouldn't really ever need to be replaced for any reason I know of |
Ok sounds good. Follow up question - since the nwbinspector test file dandiset is on the staging server (which from my understanding is not guaranteed to continue existing?), is there a backup of these files somewhere? I saw the dandiset said some files were from user submissions so I assume not all of them can be auto-generated from the package. |
DANDI team would/should provide a big heads up on clearing any staging content or putting any such policy into place At that point, if it happens, I'd recommend moving it to the main archive and publishing official persistent releases |
While working on #507 noticed some needlessly complicated setup to a very particular corner of the testing suite
Replacing it all with a simple environment variable