Test UNAGI (UNAnnotated Gene Identifier) is a pipeline allowing for the detection and annotation of transcripts from long-read sequences (usually from Oxford Nanopore Technologies Sequencers) with the help of a genome file from the studied organism.
It will typically be used as follows
On Linux:
$ ./unagi -i [path_to_fastq_file] -o [path_to_desired_output] -g [path_to_genome_file]
On Windows:
> unagi.bat -i [path_to_fastq_file] -o [path_to_desired_output] -g [path_to_genome_file]
The results are classified between transitional files in their own folder and final files.
Final files are the main results. They are presented in the bed format.
Transitional files are the files generated throughout the pipeline run. They can be in different formats and will be discussed in details in the "Detailed Configuration" part of this document.
UNAGI requires python and BioPython to run.
It was tested using python3 but should run with python 2.7 as well.
You can check if python is already on your system by typing the following command in your command line
$ python3 --version
If you get a version number, you can skip to installing BioPython.
Otherwise you will have to install python using one of the following methods depending on your OS.
install python through apt-get:
$ sudo apt-get update
$ sudo apt-get install python3.6
install python through yum:
$ sudo yum upgrade
$ sudo yum install python3
Download the installer from the official python download page and run it.
Be sure to check the option "Add python.exe to Path" during the installation.
Once python is installed, the BioPython module is easily installed using pip from the command line:
$ pip install biopython
UNAGI should now be ready to run. Check it by going to the unagi directory and type the following command:
cd /path/to/unagi/directory
./unagi -v
Alternatively, if you want to run a specific version of python, you can use:
cd /path/to/unagi/directory
/my/preferred/python app/unagi.py -v
Required
-i or --input
Input file. This should be the path to a fastq file.
-o or --output
Output path. This should be the path to output the result files to.
-g or --genome
Genome File. This should be a valid genome file for minimap.
Optional
-v or --version
Displays the program version and exits.
-s or --stranded
Stranded. Should be selected if the input file contains reads that are already stranded.
The input file should then be the fastq file containing the stranded reads
-V or --verbose
Verbose. Displays additional information while running.
-S or --silent
Runs silently (no console output), cancels verbose.
More granular configuration can be made through the conf.ini file located in the app folder.
These options are the path to the other programs used by UNAGI to deliver its results. They come prepackaged with the pipeline but can be replaced by other versions by changing their path in the conf.ini file.
minimap_path
samtools_path
bedtools_path
These options are diverse variables that are used by UNAGI to detect or filter its results. They are optimized for our research in wheat but can be tweaked in the conf.ini file to adapt for other types of genomes.
Stranding
strand_forwards_identifier
strand_backwards_identifier
The sequences used to determine the strand of a read, they will be searched for in the position range determined by strand_start_index and strand_end_index
strand_start_index
strand_end_index
The range in which to search for strand_forwards_identifier and strand_backwards_identifier in order to strand the reads
Transcript Detection
min_coverage_threshold
The amount of coverage that will trigger the detection of a start or end site of a gene when looking for coverage breaks.
min_3dash_threshold
min_5dash_threshold
The amount of coverage that will make a 3/ or 5/ site considered as relevant
min_3dash_peak_separation
min_5dash_peak_separation
The minimum separation between two 3/ sites or two 5/ sites for them to be considered distinct. If within this distance, the peaks will be clustered together.
min_3dash_end_separation
min_5dash_start_separation
The minimum separation between a 3/ site or 5/site with the end or start of a gene (respectively) for it to trigger a cut. If the 3/ site or 5/ site is too close to its relevant gene end, it will be ignored.
max_5dash_offset
The minimum distance between a 3/ site cut and its corresponding 5/ site. If a 5/ site is found within this distance, it will be skipped and the next 5/ site will be used instead.
Splice Isoforms Detection
max_coverage_to_splice_ratio
The minimum ratio to of the total coverage required for an isoform to be considered relevant.
min_exon_length
max_polyA_length
max_single_base_to_length_ratio
When looking for splicing isoforms, exons with a length under min_exon_length will be checked for long polyA or polyT chains. If such an exon has a polyA or polyT chain longer than max_polyA_length, it will be removed. If it is composed of more than max_single_base_to_length_ratio worth of A bases or T bases, it will also be removed.
max_splice_difference=10
This is used when looking for the best isoform of the same gene. Two isoforms will be considered the same if their splice site either starts or ends within max_splice_difference of each other.
These options are the command line options used when running the tools packaged with UNAGI. As changing options can change the output of a command and make it incompatible with the next step, caution is recommended when altering these options.
minimap_options=-ax splice -G 5k --secondary=no
samtobam_options=view -Sb
bamtobed_options=bamtobed -i
bamtobed_split_options=bamtobed -split -i
getfasta_options=getfasta
sortbam_options=sort
genomecov_options=genomecov -d
genomecov3dash_options=genomecov -dz -3
genomecov5dash_options=genomecov -dz -5
These options are the names of the transitional files created throughout a run of the UNAGI pipeline. They can be changed freely as it won't impact the run.
Stranding
stranded_file=stranded.fastq
The fastq file created after stranding the reads. This will be ignored if the user provides an already stranded file using the -s option.
Transcript Detection
raw_mapped_sam_file=raw_mapped.sam
raw_mapped_bam_file=raw_mapped.bam
The sam file obtained by mapping the stranded file to the genome and its bam file conversion.
raw_sorted_bam_file=raw_sorted.bam
The sorted bam file obtained from the mapped files above.
raw_sorted_bed_file=raw_sorted.bed
The bed file obtained from the bam file above. It contains the positions of the start and end site of each read.
raw_sorted_split_bed_file=raw_sorted_split.bed
Another bed file obtained from the bam file above. It contains the positions of the start and end site of each exon for each read
positive_bed_file=positive.bed
negative_bed_file=negative.bed
The contents of raw_sorted_bed_file separated in positive and negative reads.
positive_refined_fasta_file=positive.fasta
negative_refined_fasta_file=negative.fasta
Two fasta files created by taking the positions from the bed files and using the genome file to fill their sequences.
positive_mapped_sam_file=positive_mapped.sam
negative_mapped_sam_file=negative_mapped.sam
positive_mapped_bam_file=positive_mapped.bam
negative_mapped_bam_file=negative_mapped.bam
Two sam files obtained by mapping the fasta files above to the genome and their bam conversions.
positive_sorted_bam_file=positive_sorted.bam
negative_sorted_bam_file=negative_sorted.bam
The sorted bam files obtained from the files above.
positive_coverage_file=positive_coverage.txt
negative_coverage_file=negative_coverage.txt
total_coverage_file=total_coverage.txt
The coverage of each position of each gene obtained from the sorted bam files above. total_coverage_file contains the cumulative coverage for each position.
positive_genelist_incomplete_file=positive_genelist_incomplete.bed
negative_genelist_incomplete_file=negative_genelist_incomplete.bed
The gene lists obtained by searching for coverage breaks.
positive_3dash_file=positive_3dash_positions.txt
negative_3dash_file=negative_3dash_positions.txt
positive_5dash_file=positive_5dash_positions.txt
negative_5dash_file=negative_5dash_positions.txt
Files containing the positions of each 3/ and 5/ sites from the reads in positive_sorted_bam_file and negative_sorted_bam_file
positive_genelist_file=positive_genelist.bed
negative_genelist_file=negative_genelist.bed
The gene lists obtained by cutting the gene lists above using the 3/ and 5/ positions.
Splice Isoforms Detection
raw_splice_sites_file=raw_splice_sites.txt
A file containing the reads with their splice sites using the exons found in raw_sorted_split_bed_file above
coverage_filtered_splice_sites_file=coverage_filtered_splice_sites.txt
The file obtained by filtering the reads list above using the coverage generated in total_coverage_file above
genome_filtered_splice_sites_file=genome_filtered_splice_sites.txt
The file obtained by filtering the reads list above using the genome file to remove very short exons consisting almost exclusively of A or T bases.
best_filtered_splice_sites_file=best_filtered_splice_sites.txt
The result of extracting only the best isoforms for each gene.
These options are the names of the final output files of the UNAGI pipeline. They can be changed freely as it won't impact the run.
full_genelist_file=Full_Genelist.bed
The full list of genes found by UNAGI. This is the combination of positive_genelist_file and negative_genelist_file. It is given in the simplified bed format.
final_splice_sites_file=Splicing_Isoforms.bed
The full list of splicing isoforms found by UNAGI. It is given in the full bed format.
final_unique_splice_sites_file=Splicing_Isoforms_Unique.bed
The list of the best splicing isoforms found by UNAGI for each gene. It is given in the full bed format.