Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Par framework should support nested parallelism #12

Open
lars-t-hansen opened this issue Jan 21, 2015 · 0 comments
Open

Par framework should support nested parallelism #12

lars-t-hansen opened this issue Jan 21, 2015 · 0 comments

Comments

@lars-t-hansen
Copy link
Owner

Nested parallelism is probably desirable, ie, a worker should be allowed to invoke Par.invoke(), suspending until that subcomputation is done. Such a facility would allow computations to be subdivided recursively.

(Broadcast and eval are in a sense less obvious because they modify global state in the workers. Invoke can do that too, but doesn't have to.)

Recursive invoke() can probably be implemented by having a notion of nested work sets, one work set at each nesting level. A worker might grab a work item from the innermost set, until that set is exhausted, or might grab a work item from a set with some probability that is higher for inner sets and lower for outer sets. Presumably work has been done on this kind of problem before.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant