Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

doParallel performance on windows edition R #24

Open
ygidtu opened this issue Feb 11, 2019 · 2 comments
Open

doParallel performance on windows edition R #24

ygidtu opened this issue Feb 11, 2019 · 2 comments

Comments

@ygidtu
Copy link

ygidtu commented Feb 11, 2019

When I try to use scImpute, the ncores is useless. It will use all the CPU resources automatically.

As far as I know, Windows system has different parallel mechanism with Unix-based system like: Linux and OSX. Therefore the doParallel package design different usages for Windows and Unix. (Please see: https://stackoverflow.com/questions/45819337/option-cores-from-package-doparallel-useless-on-windows).

And the point is the R installed by conda is a Windows edition. So I compared the difference between system default R (3.5.2; Ubuntu 16.04) and conda installed R (3.5.1; Platform x86_64-conda_cos6-linux-gnu).

image

So can you check how to avoid this issue?

@aziway53
Copy link

git1
"ncores = 1" is working on windows, is it ok?

@ygidtu
Copy link
Author

ygidtu commented Feb 13, 2019

git1
"ncores = 1" is working on windows, is it ok?

I didn't test on a Windows version of R, I just very positive this is due to conda R.
And the conda R is not regular version of R, it's microsoft enhanced distribution of R (MRAN: https://mran.microsoft.com/open).
So I guess this is the reason

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants