Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump GUNC and add gunc/run test #6920

Merged
merged 25 commits into from
Nov 26, 2024
Merged

Conversation

dialvarezs
Copy link
Contributor

@dialvarezs dialvarezs commented Nov 1, 2024

This PR includes:

  • Version bump in all GUNC modules
  • A modification in the gunc/run module to accept multiple input files
  • Add tests for gunc/run and gunc/mergecheckm

PR checklist

  • This comment contains a description of changes (with reason).
  • If you've fixed a bug or added code that should be tested, add tests!
  • If you've added a new tool - have you followed the module conventions in the contribution docs
  • If necessary, include test data in your PR.
  • Remove all TODO statements.
  • Emit the versions.yml file.
  • Follow the naming conventions.
  • Follow the parameters requirements.
  • Follow the input/output options guidelines.
  • Add a resource label
  • Use BioConda and BioContainers if possible to fulfil software requirements.
  • Ensure that the test works with either Docker / Singularity. Conda CI tests can be quite flaky:
    • For modules:
      • nf-core modules test <MODULE> --profile docker
      • nf-core modules test <MODULE> --profile singularity
      • nf-core modules test <MODULE> --profile conda
    • For subworkflows:
      • nf-core subworkflows test <SUBWORKFLOW> --profile docker
      • nf-core subworkflows test <SUBWORKFLOW> --profile singularity
      • nf-core subworkflows test <SUBWORKFLOW> --profile conda

@dialvarezs dialvarezs requested a review from a team as a code owner November 1, 2024 06:47
@dialvarezs dialvarezs marked this pull request as draft November 1, 2024 06:57
@dialvarezs dialvarezs marked this pull request as ready for review November 1, 2024 08:35
@dialvarezs dialvarezs mentioned this pull request Nov 1, 2024
11 tasks
@jfy133
Copy link
Member

jfy133 commented Nov 5, 2024

@dialvarezs this looks good but the module updates need to come via PRs into https://github.com/nf-core/modules and added to the pipline with nf-core modules update <module>/<subcommand>

@jfy133 jfy133 marked this pull request as draft November 5, 2024 11:57
@dialvarezs
Copy link
Contributor Author

@jfy133 I don't get what you mean exactly. This is nf-core/modules, or am I doing something wrong?

@jfy133
Copy link
Member

jfy133 commented Nov 11, 2024

I mixed up my PRs, sorry @dialvarezs ! You're all good here once snapshots updated 😅 (thoguht this was the mag PR...)

@dialvarezs dialvarezs marked this pull request as ready for review November 22, 2024 13:19
@dialvarezs
Copy link
Contributor Author

I guess these tests are too much for GitHub runners 🤔

Copy link
Member

@jfy133 jfy133 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Comment on lines 1 to 5
process {
withName: CHECKM_QA {
ext.args = "--tab_table"
}
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is nicer method of specifying these now with instructions merged in last week, so they are next to the test definition, try it out!

https://nf-co.re/docs/guidelines/components/modules#configuration-of-extargs-in-tests

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried it but setting the params inside run() doesn't seem to work (and it's not covered in the docs), so I left the args in nextflow.config again.

modules/nf-core/gunc/run/meta.yml Outdated Show resolved Hide resolved
@dialvarezs dialvarezs enabled auto-merge November 26, 2024 10:12
@dialvarezs dialvarezs disabled auto-merge November 26, 2024 11:32
@dialvarezs dialvarezs enabled auto-merge November 26, 2024 11:33
@dialvarezs
Copy link
Contributor Author

@jfy133 Would it be possible to merge this despite the failing tests? The failures are because GitHub runners are running out of space while uncompressing the database, which seems unavoidable.

@jfy133
Copy link
Member

jfy133 commented Nov 26, 2024

Mmm it's not ideal... How big is the database?

@dialvarezs
Copy link
Contributor Author

dialvarezs commented Nov 26, 2024

Around 21G (7 compressed + 14 uncompressed)

@jfy133
Copy link
Member

jfy133 commented Nov 26, 2024

well poop.

I guess course of action:

  1. See if the checkm2 Devs have their own very small test database we can 'borrow'
  2. If not, remove tests (or comment out), only include stub test for GitHub auctions

@dialvarezs dialvarezs added this pull request to the merge queue Nov 26, 2024
Merged via the queue into nf-core:master with commit b6515a0 Nov 26, 2024
27 checks passed
@dialvarezs dialvarezs deleted the dev-gunc branch November 26, 2024 20:28
LouisLeNezet pushed a commit to LouisLeNezet/modules that referenced this pull request Dec 4, 2024
* Bump GUNC and add gunc/run test

* Fix meta, use input_dir

* Add snapshots

* Change strategy to preserve filenames

* Add gunc/mergecheckm test

* Update tags

* Fix test names

* Update snapshots

* Add stubs

* Add stub snaps

* Address review comments

* Set args in nextflow.config again

* Comment problematic tests

* Comment another test

---------

Co-authored-by: Edmund Miller <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants