Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory options missing from SGE template #298

Closed
nickholway opened this issue Feb 23, 2023 · 3 comments · Fixed by #299
Closed

Memory options missing from SGE template #298

nickholway opened this issue Feb 23, 2023 · 3 comments · Fixed by #299

Comments

@nickholway
Copy link
Contributor

The memory flag in the Q function has no entry in the SGE (ie AGE / UGE) template file which means that no memory requests are passed through to SGE.

I'm on R4.2.1 and Clustermq 0.8.95.3. Full Session info:

R version 4.2.1 (2022-06-23)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: CentOS Linux 7 (Core)

Matrix products: default
BLAS/LAPACK: /usr/prog/FlexiBLAS/3.0.4-GCC-11.2.0/lib64/libflexiblas.so.3.0

locale:
 [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C               LC_TIME=en_US.UTF-8        LC_COLLATE=en_US.UTF-8     LC_MONETARY=en_US.UTF-8   
 [6] LC_MESSAGES=en_US.UTF-8    LC_PAPER=en_US.UTF-8       LC_NAME=C                  LC_ADDRESS=C               LC_TELEPHONE=C            
[11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C       

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] clustermq_0.8.95.3

loaded via a namespace (and not attached):
 [1] compiler_4.2.1   fastmap_1.1.0    cli_3.4.0        htmltools_0.5.3  tools_4.2.1      rstudioapi_0.14  yaml_2.3.5       Rcpp_1.0.9      
 [9] rmarkdown_2.15   codetools_0.2-18 knitr_1.40       xfun_0.33        digest_0.6.29    rlang_1.0.6      evaluate_0.16   ```
mschubert added a commit that referenced this issue Apr 2, 2023
This means clustermq will make a memory request the SGE (or similar) schedulers. I set the default to 1GB

Co-authored-by: Michael Schubert <[email protected]>
@mschubert
Copy link
Owner

mschubert commented Dec 7, 2023

@nickholway what version of SGE were you using?

I've run tests on 8.1.9 and it didn't recognize the m_mem_free option. The docs I found also mentioned mem_free and not m_mem_free.

@nickholway
Copy link
Contributor Author

We're on a slightly old version of UGE, 8.6.4. Looking at the Man page for it, m_mem_free is mentioned in it.

@mschubert
Copy link
Owner

Thanks! I found it in some other docs as well, so we'll keep it as a default.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants