Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨ test Snakemake workflow with more recent Python versions #66

Merged
merged 34 commits into from
May 31, 2024

Conversation

enryH
Copy link
Member

@enryH enryH commented May 7, 2024

  • test workflow against python 3.9

  • remove snakemake upper dependency

  • separate environments for R and Python in workflow

  • test v2 of basic Snakemake workflow, prepare switch

  • fix errors with mini-batches of one sample during training

  • added scripts using during revisions

  • update documentation

Henry added 9 commits May 7, 2024 08:55
- check if local windows error with pandas can be reproduced in action (corr)
- add for simulated missing values
- remove duplication
- 🐛 do not omit last bin
if all values are higher than the default threshold, the assertion on L17 is not met. Make sure some NAs (missing values) are set.
- see if this works also with pandas 1.5.3
- for creating the latent representation, now a new DataLoader is needed.
@enryH enryH force-pushed the snakemake_update branch from d3d1a66 to 3447021 Compare May 15, 2024 15:20
- separate environment for PIMMS models and R based models
- global environment should still work
@enryH enryH force-pushed the snakemake_update branch from 3447021 to 409ed9c Compare May 15, 2024 15:29
Henry added 5 commits May 16, 2024 09:05
… R sesssion

- only execute one job at a time in retry to see errors better
- once this passes, add ald analysis to website (for a reasonable subset of models)
- maybe only showcase PIMMS models with a handful of other models
- also remove two slowest models
@enryH enryH force-pushed the snakemake_update branch from d1ff96e to 6965107 Compare May 22, 2024 08:30
Henry added 2 commits May 22, 2024 15:42
- hide code cells for generated report
- isort imports
- add some functionality required to collect source data for reporting on saved figures.
@enryH enryH force-pushed the snakemake_update branch from c9a1fba to 46603d3 Compare May 24, 2024 09:01
- several adaptions to slightly different design between ALD and Alzheimer data
@enryH enryH force-pushed the snakemake_update branch from 46603d3 to 3fadded Compare May 24, 2024 10:56
Henry added 3 commits May 24, 2024 14:00
- uncommon names should have a file ending specifying Snakefiles.
- execution should work, but subfolders need their own index.rst
- need to adapt script for updating main index.rst

See if everything runs for now.
@enryH enryH force-pushed the snakemake_update branch from b2c39fe to 9290d72 Compare May 27, 2024 09:22
Henry added 3 commits May 27, 2024 13:31
- mapping titles in sphinx (cross-referencing) otherwise does not work
- for better inspection of generated report for example
add some comments and streamline cells.
@enryH enryH force-pushed the snakemake_update branch from 7c9a18d to cac23b2 Compare May 28, 2024 13:14
@enryH enryH marked this pull request as ready for review May 30, 2024 14:54
@enryH enryH merged commit 7377441 into dev May 31, 2024
26 checks passed
@enryH enryH deleted the snakemake_update branch July 2, 2024 06:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant