Skip to content
This repository has been archived by the owner on Aug 27, 2024. It is now read-only.

Serialize Snakefiles from YAMLs #3

Open
imallona opened this issue Feb 2, 2024 · 4 comments
Open

Serialize Snakefiles from YAMLs #3

imallona opened this issue Feb 2, 2024 · 4 comments
Assignees
@DanInci @imallona

Comments

@imallona
Copy link
Member

imallona commented Feb 2, 2024

No description provided.

@imallona imallona self-assigned this Feb 5, 2024
@imallona
Copy link
Member Author

imallona commented Feb 5, 2024

Developing at branch dev https://github.com/omnibenchmark/omni_workflow/tree/dev

@imallona
Copy link
Member Author

Consensus (whole team): use starts_to_be_explicit YAML

@imallona
Copy link
Member Author

PR prototype

@DanInci DanInci self-assigned this Mar 18, 2024
@DanInci
Copy link
Contributor

DanInci commented Mar 24, 2024 •
edited
Loading

What the Serialization of Snakemake file includes

Mandatory:

  • Include LinkML Omni-Schema
  • Dynamically generate rules
  • Link inputs to outputs
  • Nest multiple method runs, due to multiple input values
  • Manage exclusions
  • Hash params and runs

Nice to have:

  • Allow paths to be colapsed if multiple parameters / runs do not exist for module
  • Write multiple benchmark examples to verify integrity of the generated Snakefile
  • Logic validation for benchmark.yaml file
  • Cofigurable / Customizable output paths for files
  • Found corner cases:
    • If inputs are taken from previous steps, then the execution is redundant (e.g. both M1 and M2 when taking the inputs from data stage and skipping processing step, then execution paths become redundant)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@DanInci DanInci

@imallona imallona

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@DanInci @imallona