Add an option for multiple samples

[fmalmeida]

Add an option to facilitate and organize the execution of the pipeline for multiple samples. Maybe create something using a YAML syntax as it is done in bacannot.

[fmalmeida]

Implementation under development in branch issue-15.

[fmalmeida]

The implementation is already undergoing with something similar to what is done in bacannot samplesheet.

The implementation shall go step-by-step and execution tests must be performed. A workflow will only start to be implemented when the other has been fully developed and tested.

Checklist:

short-reads only

• Implement YAML samplesheet for short-reads only workflows
• execute assembly with paired end reads
• execute assembly with single end reads
• execute assembly with both paired single end reads

long reads only

• Implement YAML samplesheet for long-reads only workflows
• execute assembly with nanopore reads, without nanopolish
• execute assembly with nanopore reads, with nanopolish
• execute assembly with pacbio reads, without gcpp
• execute assembly with pacbio reads, with gcpp

Think about medaka model. It should be defined for each sample in the YAML or it must continue as a "outside-YAML" general parameter that sets the value for all samples?

Hybrid assembly

strategy 1

• Implement YAML samplesheet for hybrid workflows, in strategy 1.
• execute strategy one assembly with paired end reads + nanopore
• execute strategy one assembly with single end reads + nanopore
• execute strategy one assembly with both paired and single end reads + nanopore
• execute strategy one assembly with paired end reads + pacbio
• execute strategy one assembly with single end reads + pacbio
• execute strategy one assembly with both paired and single end reads + pacbio

strategy 2

• Implement YAML samplesheet for hybrid workflows, in strategy 2.
• execute strategy two assembly with paired end reads + nanopore
• execute strategy two assembly with single end reads + nanopore
• execute strategy two assembly with both paired and single end reads + nanopore
• execute strategy two assembly with paired end reads + pacbio
• execute strategy two assembly with single end reads + pacbio
• execute strategy two assembly with both paired and single end reads + pacbio

[fmalmeida]

Almost finished!

It was required to make some changes in the way the channels were called and created. So now everything seems properly implemented ...

However, I will have to execute all the tests again to make sure everything is ok and it can be released.

While the tests run, I will start working on the new documentation.

[fmalmeida]

All seems to be working.

Now finish the documentation for release.

[fmalmeida]

Little update on tests:

• The use of gcpp in the samplesheet did not work. Check how it is differing from the single sample workflow and try to create the input tuple similar to it, since it is working.

[fmalmeida]

Found an issue on how nanopolish was being called! It is now solved, with proper multi-thread and the corrected module will be available in v2.4, together with this multi-sample workflow release.

[fmalmeida]

Working on documentation for release!

[fmalmeida]

This implementation is provoking major changes in the pipeline, therefore, it will delay a littler bit more since we are trying to decide the best implementation for the parameters in and outside the YAML samplesheet in order to be the less confusing possible.

When finished, it will trigger a major release version, v3.0

[fmalmeida]

This implementation has now been made available.