Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ampvis2 tutorial first upload #4968

Open
wants to merge 83 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
83 commits
Select commit Hold shift + click to select a range
2d0fd0a
Create new tutorial.md
lenaarenot May 14, 2024
f154430
Merge pull request #1 from lenaarenot/lenaarenot-ampvis2_heatmap
lenaarenot May 14, 2024
b2d6f85
Merge branch 'galaxyproject:main' into main
lenaarenot May 22, 2024
1eb9217
Merge branch 'galaxyproject:main' into main
lenaarenot May 24, 2024
9577662
added the first section of tutorial.md
lenaarenot May 24, 2024
b4183f5
move toturial, remove wrong md
paulzierep Jun 4, 2024
c469686
Update topics/microbiome/tutorials/visualisation-ampvis/tutorial.md
lenaarenot Jun 4, 2024
e2dfb8c
Merge branch 'galaxyproject:main' into ampvis2_tutorialfirst_upload
lenaarenot Jun 4, 2024
a46a4c7
Merge branch 'galaxyproject:main' into main
lenaarenot Jun 4, 2024
3e51bc5
Merge branch 'galaxyproject:main' into ampvis2_tutorialfirst_upload
lenaarenot Jun 4, 2024
43d499e
updated text in tutorial.md, tutorial.bib, added images folder
lenaarenot Jun 15, 2024
cab46de
add lena as contributor
paulzierep Jun 19, 2024
df55b63
merge with remote
lenaarenot Jun 19, 2024
1ff4ac1
revert
lenaarenot Jun 19, 2024
311d263
change version
paulzierep Jun 19, 2024
314c7b9
fixed images and citations
lenaarenot Jun 19, 2024
8818c06
fixed citations
lenaarenot Jun 19, 2024
4ecc454
updated text and added more citations
lenaarenot Jun 20, 2024
0cbda8b
tried note boxes insted of note in a text
lenaarenot Jun 20, 2024
6308d0e
added question boxes and updated text
lenaarenot Jun 24, 2024
6220ce2
updated rarefaction section
lenaarenot Jun 26, 2024
d63cd90
fixed first wuestion box
lenaarenot Jun 26, 2024
cdb80a1
fixed first question box again
lenaarenot Jun 26, 2024
c4c14b3
added hands-on how to preparedatasets out of 1 excel sheet
lenaarenot Jun 26, 2024
6623b83
fixed first question box again
lenaarenot Jun 26, 2024
e3de94c
fixed first questions box image
lenaarenot Jun 26, 2024
b9f89a6
fixed first questions box image 2.0
lenaarenot Jun 26, 2024
72d8097
fixed first questions box image 3.0
lenaarenot Jun 26, 2024
0c1d63f
fixed first questions box image 4.0
lenaarenot Jun 26, 2024
54ff88f
added last missind question section
lenaarenot Jun 26, 2024
231332f
removed to_do
lenaarenot Jun 26, 2024
7a18382
checked language for consistend formulation, added conclusions, added…
lenaarenot Jun 27, 2024
9b67890
reformulated rarefaction curve theory
lenaarenot Jun 28, 2024
453a48f
eddited paragraph, deleted 'note:' from comments
lenaarenot Jun 28, 2024
246f625
apdated zenodo names, plus zenodo link
lenaarenot Jun 29, 2024
8594ef3
apdated zenodo names, plus zenodo links (manualy)
lenaarenot Jun 29, 2024
b54a94e
a try to add tools and workflows
lenaarenot Jun 29, 2024
94c3bbb
fixed links
lenaarenot Jun 29, 2024
2f24385
added section 'uploading biom and creating phyloseq files'
lenaarenot Jul 2, 2024
676071f
restructured introduction section
lenaarenot Jul 3, 2024
b30ed67
forgot a '.'
lenaarenot Jul 3, 2024
c39f14a
added zenodo links and snipets to rarefaction, heatmap and boxplot
lenaarenot Jul 4, 2024
e9fb025
edited zenodo links and added snipets to ordination
lenaarenot Jul 4, 2024
1353a60
tried eliminating tool links
lenaarenot Jul 4, 2024
11ad21f
yaml file problems
lenaarenot Jul 4, 2024
12ab88d
yaml file problems
lenaarenot Jul 4, 2024
2f89de0
yaml file problems
lenaarenot Jul 4, 2024
07ca0b1
tried eliminating tool links
lenaarenot Jul 4, 2024
4cbd7d9
cosmetic make over
lenaarenot Jul 4, 2024
e508462
rarefaction section with sort/long versions
lenaarenot Jul 4, 2024
fd7746e
rest of sections with short/long versions
lenaarenot Jul 5, 2024
5b4ddf2
restructure and trying to fix linkage to 'datasets'
lenaarenot Jul 5, 2024
90fc24c
restructure and trying to fix linkage to 'datasets'
lenaarenot Jul 5, 2024
84815ab
updated text on amplicon backgroud, visualisation tools, ASV vs OTU, …
lenaarenot Aug 24, 2024
4eaf108
use case numbering fix
lenaarenot Aug 24, 2024
8d52958
use case numbering fix
lenaarenot Aug 24, 2024
aa32b6a
updated text on heatmap, all ordination section, boxplot
lenaarenot Sep 5, 2024
8396390
fixing links
lenaarenot Sep 5, 2024
49ddaf8
fixing links
lenaarenot Sep 5, 2024
ef962d7
better heatmap pictures
lenaarenot Sep 13, 2024
b786acd
restructured use case 2 and 3 with separated tool and workflow
lenaarenot Sep 19, 2024
25885cd
fixing small errors
lenaarenot Sep 19, 2024
ff6f4b9
separated rerafaction section in tools, changed ampvis load and subsa…
lenaarenot Sep 25, 2024
1b29428
manually took over all correction suggestions and made bullet points …
lenaarenot Oct 18, 2024
a375972
fixing not rendered comment
lenaarenot Oct 18, 2024
2483280
fixing not rendered comment
lenaarenot Oct 18, 2024
f99100a
adding lotus2 and merginh mothur tools to 1 bullet point
lenaarenot Oct 18, 2024
40df775
correct comment style
lenaarenot Oct 18, 2024
d9b9baf
bullet points of formats
lenaarenot Oct 18, 2024
7874ba5
specific zenodo link representation
lenaarenot Oct 18, 2024
26adefe
specific zenodo link representation for use case 1
lenaarenot Oct 18, 2024
94f024c
specific zenodo link representation for use case 1 v2
lenaarenot Oct 18, 2024
dd4e3f4
specific zenodo link representation for use case 1 v3
lenaarenot Oct 18, 2024
2b246ca
specific zenodo link representation for use case 1 v4
lenaarenot Oct 18, 2024
d80fe3c
made biom and phylosec a subsection
lenaarenot Oct 18, 2024
ed1304f
rephrasing the part of Kraken and MataPhlAn
lenaarenot Oct 18, 2024
09b386a
testing link optics
lenaarenot Oct 18, 2024
39e57b8
bullet points of ploting types with link
lenaarenot Oct 18, 2024
c4163eb
bullet points of ploting types with link + fixing paragraph look
lenaarenot Oct 18, 2024
b10cbd2
rephrased all 'we' sentances to passive voice
lenaarenot Oct 18, 2024
b8d0106
specific zenodo link representation for use case 1 and 2 v5
lenaarenot Oct 25, 2024
9ca50f9
plot types final links
lenaarenot Oct 25, 2024
41ca9bc
Merge branch 'main' into ampvis2_tutorialfirst_upload
shiltemann Dec 5, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 28 additions & 0 deletions topics/microbiome/tutorials/visualisation-ampvis/data-library.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
---
destination:
type: library
name: GTN - Material
description: Galaxy Training Network Material
synopsis: Galaxy Training Network Material. See https://training.galaxyproject.org
items:
- name: The new topic
description: Summary
items:
- name: Development of statistical analysis and visualization workflows for metagenomic
amplicon data using the Galaxy framework
items:
- name: 'DOI: 10.5281/zenodo.11281381'
description: latest
items:
- url: https://zenodo.org/api/records/11281381/files/Galaxy11-[MiDAS_otushort_table.tsv].mothur.axes/content
lenaarenot marked this conversation as resolved.
Show resolved Hide resolved
src: url
ext: auto
info: https://zenodo.org/records/11281381
- url: https://zenodo.org/api/records/11281381/files/Galaxy1-[MiDAS_metadata.tsv].tabular/content
src: url
ext: auto
info: https://zenodo.org/records/11281381
- url: https://zenodo.org/api/records/11281381/files/Galaxy3-[MiDAS_taxtable.tsv].tabular/content
src: url
ext: auto
info: https://zenodo.org/records/11281381
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
---
layout: faq-page
---
42 changes: 42 additions & 0 deletions topics/microbiome/tutorials/visualisation-ampvis/tutorial.bib
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@

# This is the bibliography file for your tutorial.
#
# To add bibliography (bibtex) entries here, follow these steps:
# 1) Find the DOI for the article you want to cite
# 2) Go to https://doi2bib.org and fill in the DOI
# 3) Copy the resulting bibtex entry into this file
#
# To cite the example below, in your tutorial.md file
# use {% cite Batut2018 %}
#
# If you want to cite an online resourse (website etc)
# you can use the 'online' format (see below)
#
# You can remove the examples below

lenaarenot marked this conversation as resolved.
Show resolved Hide resolved
@article{Batut2018,
doi = {10.1016/j.cels.2018.05.012},
url = {https://doi.org/10.1016/j.cels.2018.05.012},
year = {2018},
month = jun,
publisher = {Elsevier {BV}},
volume = {6},
number = {6},
pages = {752--758.e1},
author = {B{\'{e}}r{\'{e}}nice Batut and Saskia Hiltemann and Andrea Bagnacani and Dannon Baker and Vivek Bhardwaj and
Clemens Blank and Anthony Bretaudeau and Loraine Brillet-Gu{\'{e}}guen and Martin {\v{C}}ech and John Chilton
and Dave Clements and Olivia Doppelt-Azeroual and Anika Erxleben and Mallory Ann Freeberg and Simon Gladman and
Youri Hoogstrate and Hans-Rudolf Hotz and Torsten Houwaart and Pratik Jagtap and Delphine Larivi{\`{e}}re and
Gildas Le Corguill{\'{e}} and Thomas Manke and Fabien Mareuil and Fidel Ram{\'{i}}rez and Devon Ryan and
Florian Christoph Sigloch and Nicola Soranzo and Joachim Wolff and Pavankumar Videm and Markus Wolfien and
Aisanjiang Wubuli and Dilmurat Yusuf and James Taylor and Rolf Backofen and Anton Nekrutenko and Bj\"{o}rn Gr\"{u}ning},
title = {Community-Driven Data Analysis Training for Biology},
journal = {Cell Systems}
}

@online{gtn-website,
author = {GTN community},
title = {GTN Training Materials: Collection of tutorials developed and maintained by the worldwide Galaxy community},
url = {https://training.galaxyproject.org},
urldate = {2021-03-24}
}
260 changes: 260 additions & 0 deletions topics/microbiome/tutorials/visualisation-ampvis/tutorial.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,260 @@
---
layout: tutorial_hands_on

title: Development of statistical analysis and visualization workflows for metagenomic
lenaarenot marked this conversation as resolved.
Show resolved Hide resolved
amplicon data using the Galaxy framework
level: Intermediate
zenodo_link: https://zenodo.org/records/11281381
questions:
lenaarenot marked this conversation as resolved.
Show resolved Hide resolved
- If we generated amplicon data, how can we analyse it with Galaxy ampvis2 tools?
- How can we visualise amplicon data by using heatmap, ordination plot, boxplot, rarefraction curve or timeseries?
objectives:
- use heatmap workflow to analyse and visualise amplicon data
- or use ordination plot, or boxplot, or rarefraction curve, or timeseries
lenaarenot marked this conversation as resolved.
Show resolved Hide resolved
- use grouped data or grouped data with facets
time_estimation: 3H
key_points:
- using different visualisation methods can present data from other points of view
- with enough metadata the data can be visualised w.r.t. groups and facets
lenaarenot marked this conversation as resolved.
Show resolved Hide resolved
contributors:
- lenaarenot
- contributor2
lenaarenot marked this conversation as resolved.
Show resolved Hide resolved

---



General introduction about the topic and then an introduction of the
lenaarenot marked this conversation as resolved.
Show resolved Hide resolved
tutorial (the questions and the objectives). It is nice also to have a
scheme to sum up the pipeline used during the tutorial. The idea is to
give to trainees insight into the content of the tutorial and the (theoretical
and technical) key concepts they will learn.

You may want to cite some publications; this can be done by adding citations to the
bibliography file (`tutorial.bib` file next to your `tutorial.md` file). These citations
must be in bibtex format. If you have the DOI for the paper you wish to cite, you can
get the corresponding bibtex entry using [doi2bib.org](https://doi2bib.org).

With the example you will find in the `tutorial.bib` file, you can add a citation to
this article here in your tutorial like this:
{% raw %} `{% cite Batut2018 %}`{% endraw %}.
This will be rendered like this: {% cite Batut2018 %}, and links to a
[bibliography section](#bibliography) which will automatically be created at the end of the
tutorial.

<!-- This is a comment. -->

**Please follow our
[tutorial to learn how to fill the Markdown]({{ site.baseurl }}/topics/contributing/tutorials/create-new-tutorial-content/tutorial.html)**

> <agenda-title></agenda-title>
>
> In this tutorial, we will cover:
>
> 1. TOC
> {:toc}
>
{: .agenda}

# Title for your first section

Give some background about what the trainees will be doing in the section.
Remember that many people reading your materials will likely be novices,
so make sure to explain all the relevant concepts.

## Title for a subsection
Section and subsection titles will be displayed in the tutorial index on the left side of
the page, so try to make them informative and concise!

# Hands-on Sections
Below are a series of hand-on boxes, one for each tool in your workflow file.
Often you may wish to combine several boxes into one or make other adjustments such
as breaking the tutorial into sections, we encourage you to make such changes as you
see fit, this is just a starting point :)

Anywhere you find the word "***TODO***", there is something that needs to be changed
depending on the specifics of your tutorial.

have fun!

## Get data

> <hands-on-title> Data Upload </hands-on-title>
>
> 1. Create a new history for this tutorial
> 2. Import the files from [Zenodo]({{ page.zenodo_link }}) or from
> the shared data library (`GTN - Material` -> `{{ page.topic_name }}`
> -> `{{ page.title }}`):
>
> ```
> https://zenodo.org/api/records/11281381/files/Galaxy11-[MiDAS_otushort_table.tsv].mothur.axes/content
> https://zenodo.org/api/records/11281381/files/Galaxy1-[MiDAS_metadata.tsv].tabular/content
> https://zenodo.org/api/records/11281381/files/Galaxy3-[MiDAS_taxtable.tsv].tabular/content
> ```
> ***TODO***: *Add the files by the ones on Zenodo here (if not added)*
>
> ***TODO***: *Remove the useless files (if added)*
>
> {% snippet faqs/galaxy/datasets_import_via_link.md %}
lenaarenot marked this conversation as resolved.
Show resolved Hide resolved
>
> {% snippet faqs/galaxy/datasets_import_from_data_library.md %}
>
> 3. Rename the datasets
> 4. Check that the datatype
>
> {% snippet faqs/galaxy/datasets_change_datatype.md datatype="datatypes" %}
>
> 5. Add to each database a tag corresponding to ...
>
> {% snippet faqs/galaxy/datasets_add_tag.md %}
>
{: .hands_on}

# Title of the section usually corresponding to a big step in the analysis

It comes first a description of the step: some background and some theory.
Some image can be added there to support the theory explanation:

![Alternative text](../../images/image_name "Legend of the image")

The idea is to keep the theory description before quite simple to focus more on the practical part.

***TODO***: *Consider adding a detail box to expand the theory*

> <details-title> More details about the theory </details-title>
>
> But to describe more details, it is possible to use the detail boxes which are expandable
>
{: .details}

A big step can have several subsections or sub steps:


## Sub-step with **ampvis2 load**

> <hands-on-title> Task description </hands-on-title>
>
> 1. {% tool [ampvis2 load](toolshed.g2.bx.psu.edu/repos/iuc/ampvis2_load/ampvis2_load/2.8.6+galaxy1) %} with the following parameters:
> - {% icon param-file %} *"OTU table"*: `output` (Input dataset)
> - {% icon param-file %} *"Sample metadata"*: `output` (Input dataset)
> - {% icon param-file %} *"Taxonomy table"*: `output` (Input dataset)
>
> ***TODO***: *Check parameter descriptions*
>
> ***TODO***: *Consider adding a comment or tip box*
>
> > <comment-title> short description </comment-title>
> >
> > A comment about the tool or something else. This box can also be in the main text
> {: .comment}
>
{: .hands_on}

***TODO***: *Consider adding a question to test the learners understanding of the previous exercise*

> <question-title></question-title>
>
> 1. Question1?
> 2. Question2?
>
> > <solution-title></solution-title>
> >
> > 1. Answer for question1
> > 2. Answer for question2
> >
> {: .solution}
>
{: .question}

## Sub-step with **ampvis2 subset samples**

> <hands-on-title> Task description </hands-on-title>
>
> 1. {% tool [ampvis2 subset samples](toolshed.g2.bx.psu.edu/repos/iuc/ampvis2_subset_samples/ampvis2_subset_samples/2.8.6+galaxy1) %} with the following parameters:
> - {% icon param-file %} *"Ampvis2 RDS dataset"*: `ampvis` (output of **ampvis2 load** {% icon tool %})
> - {% icon param-file %} *"Metadata list"*: `metadata_list_out` (output of **ampvis2 load** {% icon tool %})
> - *"Metadata variable"*: ``
> - *"Metadata value(s)"*: ``
>
> ***TODO***: *Check parameter descriptions*
>
> ***TODO***: *Consider adding a comment or tip box*
>
> > <comment-title> short description </comment-title>
> >
> > A comment about the tool or something else. This box can also be in the main text
> {: .comment}
>
{: .hands_on}

***TODO***: *Consider adding a question to test the learners understanding of the previous exercise*

> <question-title></question-title>
>
> 1. Question1?
> 2. Question2?
>
> > <solution-title></solution-title>
> >
> > 1. Answer for question1
> > 2. Answer for question2
> >
> {: .solution}
>
{: .question}

## Sub-step with **ampvis2 heatmap**

> <hands-on-title> Task description </hands-on-title>
>
> 1. {% tool [ampvis2 heatmap](toolshed.g2.bx.psu.edu/repos/iuc/ampvis2_heatmap/ampvis2_heatmap/2.8.6+galaxy1) %} with the following parameters:
> - {% icon param-file %} *"Ampvis2 RDS dataset"*: `ampvis` (output of **ampvis2 subset samples** {% icon tool %})
> - {% icon param-file %} *"Metadata list"*: `metadata_list_out` (output of **ampvis2 subset samples** {% icon tool %})
> - *"Group samples"*: ``
> - *"Facet the samples"*: ``
> - *"The taxonomic level to aggregate the OTUs"*: `Species`
> - *"Additional taxonomic level(s) to display"*: ``
> - *"Limit the number of shown taxa"*: `Select a number of taxa to show`
> - *"Plot the values on the heatmap"*: `Yes`
> - *"Sort heatmap by most abundant taxa"*: `No`
> - *"Show functional information about the Genus-level OTUs"*: `No`
>
> ***TODO***: *Check parameter descriptions*
>
> ***TODO***: *Consider adding a comment or tip box*
>
> > <comment-title> short description </comment-title>
> >
> > A comment about the tool or something else. This box can also be in the main text
> {: .comment}
>
{: .hands_on}

***TODO***: *Consider adding a question to test the learners understanding of the previous exercise*

> <question-title></question-title>
>
> 1. Question1?
> 2. Question2?
>
> > <solution-title></solution-title>
> >
> > 1. Answer for question1
> > 2. Answer for question2
> >
> {: .solution}
>
{: .question}


## Re-arrange

To create the template, each step of the workflow had its own subsection.

***TODO***: *Re-arrange the generated subsections into sections or other subsections.
Consider merging some hands-on boxes to have a meaningful flow of the analyses*

# Conclusion

Sum up the tutorial and the key takeaways here. We encourage adding an overview image of the
pipeline used.
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
---
layout: workflow-list
---
Loading
Loading