-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Not enough memory for BAM sorting #122
Comments
Hi,
I see the issue. Are you running this via docker or singularity, or do you
have it running natively?
best,
~b
…On Sat, Dec 10, 2022 at 5:37 AM taot2007 ***@***.***> wrote:
Hi, Brian, I am running the CTAT-mutations (v3.2.0) pipeline, the library
version is StarFv1.10. I used the commamd:
$ nohup time ~/src/CTAT-Mutations-v3.2.0/ctat_mutations --cpu 15
--genome_lib_dir
~/Share/CTAT_resource_lib/GRCh38_GENECODE_v38/build/ctat_genome_lib_build_dir/
--left ~/data/1609_R1_val_1.fq.gz
--right ~/data/1609_R2_val_2.fq.gz
--sample_id 1609
--output ~/data/CTATmutations/1609/ >
~/data/CTATmutations/ctat_mutations.nohup.out 2>&1 &
While most of the samples went well, a few samples showed the error
information as below:
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
EXITING because of fatal ERROR: not enough memory for BAM sorting:
SOLUTION: re-run STAR with at least --limitBAMsortRAM 35644206690
Dec 10 17:07:21 ...... FATAL ERROR, exiting
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
It looks very clear that the memory for BAM was set too low. Is there
anyway to get this solved? Thanks so much!
—
Reply to this email directly, view it on GitHub
<#122>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABZRKXZCHCA2XY3D4OALYCLWMRMNZANCNFSM6AAAAAAS2GBEUY>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
--
--
Brian J. Haas
The Broad Institute
http://broadinstitute.org/~bhaas <http://broad.mit.edu/~bhaas>
|
Hi Brian,
I ran it natively.
Thanks,
Ting
From: Brian Haas ***@***.***>
Sent: Saturday, December 10, 2022 10:15 PM
To: NCIP/ctat-mutations ***@***.***>
Cc: taot2007 ***@***.***>; Author ***@***.***>
Subject: Re: [NCIP/ctat-mutations] Not enough memory for BAM sorting (Issue #122)
Hi,
I see the issue. Are you running this via docker or singularity, or do you
have it running natively?
best,
~b
…On Sat, Dec 10, 2022 at 5:37 AM taot2007 ***@***.***<mailto:***@***.***>> wrote:
Hi, Brian, I am running the CTAT-mutations (v3.2.0) pipeline, the library
version is StarFv1.10. I used the commamd:
$ nohup time ~/src/CTAT-Mutations-v3.2.0/ctat_mutations --cpu 15
--genome_lib_dir
~/Share/CTAT_resource_lib/GRCh38_GENECODE_v38/build/ctat_genome_lib_build_dir/
--left ~/data/1609_R1_val_1.fq.gz
--right ~/data/1609_R2_val_2.fq.gz
--sample_id 1609
--output ~/data/CTATmutations/1609/ >
~/data/CTATmutations/ctat_mutations.nohup.out 2>&1 &
While most of the samples went well, a few samples showed the error
information as below:
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
EXITING because of fatal ERROR: not enough memory for BAM sorting:
SOLUTION: re-run STAR with at least --limitBAMsortRAM 35644206690
Dec 10 17:07:21 ...... FATAL ERROR, exiting
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
It looks very clear that the memory for BAM was set too low. Is there
anyway to get this solved? Thanks so much!
—
Reply to this email directly, view it on GitHub
<#122>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABZRKXZCHCA2XY3D4OALYCLWMRMNZANCNFSM6AAAAAAS2GBEUY>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***<mailto:***@***.***>>
--
--
Brian J. Haas
The Broad Institute
http://broadinstitute.org/~bhaas <http://broad.mit.edu/~bhaas>
—
Reply to this email directly, view it on GitHub<#122 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AI7FCPDHBD6OYDXG4PX2TLDWMSF65ANCNFSM6AAAAAAS2GBEUY>.
You are receiving this because you authored the thread.Message ID: ***@***.******@***.***>>
|
ok - I updated the devel branch on github so it now includes the
parameter --star_limitBAMsortRAM, so you can set the value that STAR
recommends or something larger.
Would you be able to pull the devel branch and give it another go?
best,
~brian
…On Sat, Dec 10, 2022 at 9:34 AM taot2007 ***@***.***> wrote:
Hi Brian,
I ran it natively.
Thanks,
Ting
From: Brian Haas ***@***.***>
Sent: Saturday, December 10, 2022 10:15 PM
To: NCIP/ctat-mutations ***@***.***>
Cc: taot2007 ***@***.***>; Author ***@***.***>
Subject: Re: [NCIP/ctat-mutations] Not enough memory for BAM sorting
(Issue #122)
Hi,
I see the issue. Are you running this via docker or singularity, or do you
have it running natively?
best,
~b
On Sat, Dec 10, 2022 at 5:37 AM taot2007 ***@***.***<mailto:***@***.***>>
wrote:
> Hi, Brian, I am running the CTAT-mutations (v3.2.0) pipeline, the
library
> version is StarFv1.10. I used the commamd:
>
> $ nohup time ~/src/CTAT-Mutations-v3.2.0/ctat_mutations --cpu 15
> --genome_lib_dir
>
~/Share/CTAT_resource_lib/GRCh38_GENECODE_v38/build/ctat_genome_lib_build_dir/
> --left ~/data/1609_R1_val_1.fq.gz
> --right ~/data/1609_R2_val_2.fq.gz
> --sample_id 1609
> --output ~/data/CTATmutations/1609/ >
> ~/data/CTATmutations/ctat_mutations.nohup.out 2>&1 &
>
> While most of the samples went well, a few samples showed the error
> information as below:
>
> XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
> EXITING because of fatal ERROR: not enough memory for BAM sorting:
> SOLUTION: re-run STAR with at least --limitBAMsortRAM 35644206690
> Dec 10 17:07:21 ...... FATAL ERROR, exiting
> XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
>
> It looks very clear that the memory for BAM was set too low. Is there
> anyway to get this solved? Thanks so much!
>
> —
> Reply to this email directly, view it on GitHub
> <#122>, or unsubscribe
> <
https://github.com/notifications/unsubscribe-auth/ABZRKXZCHCA2XY3D4OALYCLWMRMNZANCNFSM6AAAAAAS2GBEUY>
> .
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***<mailto:***@***.***>>
>
--
--
Brian J. Haas
The Broad Institute
http://broadinstitute.org/~bhaas <http://broad.mit.edu/~bhaas>
—
Reply to this email directly, view it on GitHub<
#122 (comment)>,
or unsubscribe<
https://github.com/notifications/unsubscribe-auth/AI7FCPDHBD6OYDXG4PX2TLDWMSF65ANCNFSM6AAAAAAS2GBEUY>.
You are receiving this because you authored the thread.Message ID:
***@***.******@***.***>>
—
Reply to this email directly, view it on GitHub
<#122 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABZRKX5RP3NW3IBIBJ6XPX3WMSIIFANCNFSM6AAAAAAS2GBEUY>
.
You are receiving this because you commented.Message ID:
***@***.***>
--
--
Brian J. Haas
The Broad Institute
http://broadinstitute.org/~bhaas <http://broad.mit.edu/~bhaas>
|
It worked perfectly! Thanks so much!
|
Thanks! Great to hear!
…On Sun, Dec 11, 2022 at 9:39 PM taot2007 ***@***.***> wrote:
It worked perfectly! Thanks so much!
ok - I updated the devel branch on github so it now includes the parameter
--star_limitBAMsortRAM, so you can set the value that STAR recommends or
something larger. Would you be able to pull the devel branch and give it
another go? best, ~brian
… <#m_-6267748613545710298_>
On Sat, Dec 10, 2022 at 9:34 AM taot2007 *@*.*> wrote: Hi Brian, I ran it
natively. Thanks, Ting From: Brian Haas @.*> Sent: Saturday, December 10,
2022 10:15 PM To: NCIP/ctat-mutations *@*.*> Cc: taot2007 @.*>; Author *@*
.*> Subject: Re: [NCIP/ctat-mutations] Not enough memory for BAM sorting
(Issue #122 <#122>) Hi, I see
the issue. Are you running this via docker or singularity, or do you have
it running natively? best, ~b On Sat, Dec 10, 2022 at 5:37 AM taot2007 @.*
mailto:***@***.*** <***@***.***>> wrote: > Hi, Brian, I am running the
CTAT-mutations (v3.2.0) pipeline, the library > version is StarFv1.10. I
used the commamd: > > $ nohup time
~/src/CTAT-Mutations-v3.2.0/ctat_mutations --cpu 15 > --genome_lib_dir >
~/Share/CTAT_resource_lib/GRCh38_GENECODE_v38/build/ctat_genome_lib_build_dir/
> --left ~/data/1609_R1_val_1.fq.gz > --right ~/data/1609_R2_val_2.fq.gz >
--sample_id 1609 > --output ~/data/CTATmutations/1609/ > >
~/data/CTATmutations/ctat_mutations.nohup.out 2>&1 & > > While most of the
samples went well, a few samples showed the error > information as below: >
> XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX >
EXITING because of fatal ERROR: not enough memory for BAM sorting: >
SOLUTION: re-run STAR with at least --limitBAMsortRAM 35644206690 > Dec 10
17:07:21 ...... FATAL ERROR, exiting >
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX > > It
looks very clear that the memory for BAM was set too low. Is there > anyway
to get this solved? Thanks so much! > > — > Reply to this email directly,
view it on GitHub > <#122
<#122>>, or unsubscribe > <
https://github.com/notifications/unsubscribe-auth/ABZRKXZCHCA2XY3D4OALYCLWMRMNZANCNFSM6AAAAAAS2GBEUY>
> . > You are receiving this because you are subscribed to this
thread.Message > ID: *@*.*mailto:***@***.*** <***@***.***>> > -- -- Brian
J. Haas The Broad Institute http://broadinstitute.org/~bhaas
<http://broadinstitute.org/~bhaas> http://broad.mit.edu/~bhaas
<http://broad.mit.edu/~bhaas> — Reply to this email directly, view it on
GitHub< #122 (comment)
<#122 (comment)>>,
or unsubscribe<
https://github.com/notifications/unsubscribe-auth/AI7FCPDHBD6OYDXG4PX2TLDWMSF65ANCNFSM6AAAAAAS2GBEUY>
<https://github.com/notifications/unsubscribe-auth/AI7FCPDHBD6OYDXG4PX2TLDWMSF65ANCNFSM6AAAAAAS2GBEUY%3E>.
You are receiving this because you authored the thread.Message ID: @.**@*.*>>
— Reply to this email directly, view it on GitHub <#122 (comment)
<#122 (comment)>>,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABZRKX5RP3NW3IBIBJ6XPX3WMSIIFANCNFSM6AAAAAAS2GBEUY
<https://github.com/notifications/unsubscribe-auth/ABZRKX5RP3NW3IBIBJ6XPX3WMSIIFANCNFSM6AAAAAAS2GBEUY>
. You are receiving this because you commented.Message ID: @.*>
-- -- Brian J. Haas The Broad Institute http://broadinstitute.org/~bhaas
http://broad.mit.edu/~bhaas
—
Reply to this email directly, view it on GitHub
<#122 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABZRKX4CAXIXHCR43PBI6QDWM2F7XANCNFSM6AAAAAAS2GBEUY>
.
You are receiving this because you commented.Message ID:
***@***.***>
--
--
Brian J. Haas
The Broad Institute
http://broadinstitute.org/~bhaas <http://broad.mit.edu/~bhaas>
|
Hi, Brian, I am running the CTAT-mutations (v3.2.0) pipeline, the library version is StarFv1.10. I used the commamd:
$ nohup time ~/src/CTAT-Mutations-v3.2.0/ctat_mutations --cpu 15
--genome_lib_dir ~/Share/CTAT_resource_lib/GRCh38_GENECODE_v38/build/ctat_genome_lib_build_dir/
--left ~/data/1609_R1_val_1.fq.gz
--right ~/data/1609_R2_val_2.fq.gz
--sample_id 1609
--output ~/data/CTATmutations/1609/ > ~/data/CTATmutations/ctat_mutations.nohup.out 2>&1 &
While most of the samples went well, a few samples showed the error information as below:
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
EXITING because of fatal ERROR: not enough memory for BAM sorting:
SOLUTION: re-run STAR with at least --limitBAMsortRAM 35644206690
Dec 10 17:07:21 ...... FATAL ERROR, exiting
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
It looks very clear that the memory for BAM was set too low. Is there anyway to get this solved? Thanks so much!
The text was updated successfully, but these errors were encountered: