Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resource for julia multiprocessing #8

Closed
jpfairbanks opened this issue Sep 1, 2017 · 4 comments
Closed

Resource for julia multiprocessing #8

jpfairbanks opened this issue Sep 1, 2017 · 4 comments

Comments

@jpfairbanks
Copy link
Contributor

Is there any reason not to use this package for managing distributed computing with Julia processes?

@timholy
Copy link
Owner

timholy commented Sep 1, 2017

I'm not aware of any. As you probably already noticed, it's basically a tiny "intent-signaling" package. I'd be happy to consider extensions if you discover you need them.

@jpfairbanks
Copy link
Contributor Author

Ok yeah I think this is a way for us to handle parallelism for LightGraphs. Where the algorithms and datastructures need to change based on the resources you want to use. I think we would want something like CPUThreads but for for processes. CPUProcesses? Or use case would probably have in the Settings field

  • Number of Threads
  • PartitionScheme Replicated, OneDPartition, TwoDPartition

Where 1D partition is for splitting vertices and 2D partition is for spliting edges. Like in MPI for linear algebra.

@timholy
Copy link
Owner

timholy commented Sep 6, 2017

Sounds great to me. Since the only "generic" parameter here might be nthreads and you're the first/only consumer of this functionality, I'd say just write your own specialized object for that settings field and you're good to go. If we find ourselves getting a huge number of clients of that functionality we could think about abstractions when we have enough examples to think about.

@timholy
Copy link
Owner

timholy commented Sep 8, 2017

Closed by #9

@timholy timholy closed this as completed Sep 8, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants