Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Building with multiple threads breaks remotecalls of plan_fft #135

Open
dsweber2 opened this issue Jan 31, 2020 · 1 comment
Open

Building with multiple threads breaks remotecalls of plan_fft #135

dsweber2 opened this issue Jan 31, 2020 · 1 comment

Comments

@dsweber2
Copy link

I have a package that uses distributed and creates a different fft plan for each process. When I build with more than 1 thread, it becomes incredibly slow to create the fft_plans (order of 12 hours for something that should take <1s), regardless of how many threads I actually use in that Julia process. For the purposes of debugging I've made a (mostly) minimal example here. I tried to make an example that works in just the RePL, but it appears that the building is an important aspect. For now I'm planning on specifying in the build that there should only be one thread, but I'm not sure how this would interact with ClusterManagers, where having both threaded ffts and different processes would definitely be useful.

Steps to reproduce:

  1. set JULIA_NUM_THREADS=4 based on environment
using Pkg
Pkg.add("https://github.com/dsweber2/minimalFreezingExample.jl.git")
Pkg.build("minimalFreezingExample")
Pkg.test("minimalFreezingExample")

it should hang on i=2, j=1.

This is definitely related to #121

@stevengj
Copy link
Member

Try calling FFTW.set_num_threads(1)?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants