Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve documentation for ClusterManagers, tighten function types #17688

Merged
merged 5 commits into from
Jul 30, 2016

Conversation

kshyatt
Copy link
Contributor

@kshyatt kshyatt commented Jul 28, 2016

Cleaned up formatting and wording, documented Base.process_messages a
little, made incoming a Bool (since message_handler_loop requires
this anyway).

Cleaned up formatting and wording, documented `Base.process_messages` a
little, made `incoming` a `Bool` (since `message_handler_loop` requires
this anyway).
@kshyatt kshyatt added docs This change adds or pertains to documentation parallelism Parallel or distributed computation labels Jul 28, 2016
AsyncStream hasn't existed since #12839, nearly a year ago.
Updated the parallel docs to reflect this fact and to correspond
more closely with the current state of `multi.jl` and `managers.jl`.
@vtjnash
Copy link
Member

vtjnash commented Jul 29, 2016

thanks for correcting these. I had no idea we were referencing AsyncStream in the manual.

@tkelman
Copy link
Contributor

tkelman commented Jul 29, 2016

git grep ?

.. code-block:: julia

sshflags=`-i /home/foo/bar.pem`
* ``sshflags``\ : specifies additional ssh options, e.g.:: sshflags=``-i /home/foo/bar.pem``
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

formatting looks wrong here

@kshyatt
Copy link
Contributor Author

kshyatt commented Jul 29, 2016

Any thoughts on the most recent changes @amitmurthy, @tkelman, @mweastwood ?

@amitmurthy
Copy link
Contributor

LGTM.

One other feedback would be to rearrange / further split up sections in the rst (can also be done in a different PR).

Currently we have

Tasks
General Parallel Computing Support
Shared Arrays
Multi-threading
Cluster Manager Interface 

A suggested reorg :

Tasks
Channels (including put!, take!, etc on Channels)
Cluster setup and management (addprocs, nprocs, etc)
Remotecalls and Futures (including remote expressions, i.e., `@spawn` and friends)
RemoteChannels
Cluster Manager Interface 
Shared Arrays
Multi-threading

@kshyatt
Copy link
Contributor Author

kshyatt commented Jul 30, 2016

@amitmurthy in that case I will merge in the morning and open a new PR sometime soon. I have a pair of fresh eyes reading the parallel docs for things confusing to newbies as well :)

@kshyatt kshyatt merged commit ca355ff into master Jul 30, 2016
@kshyatt kshyatt deleted the ksh/parallelagain branch July 30, 2016 15:32
If the master process fails to establish a connection with a newly launched worker within
60.0 seconds, the worker treats it as a fatal situation and terminates.
This timeout can be controlled via environment variable `JULIA_WORKER_TIMEOUT`.
The value of JULIA_WORKER_TIMEOUT` on the master process specifies the number of seconds a
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mismatched backticks

mfasi pushed a commit to mfasi/julia that referenced this pull request Sep 5, 2016
…liaLang#17688)

* Improve documentation for ClusterManagers, tighten function types

Cleaned up formatting and wording, documented `Base.process_messages` a
little, made `incoming` a `Bool` (since `message_handler_loop` requires
this anyway).

* Moved docs out of HelpDB, got rid of references to AsyncStream.

AsyncStream hasn't existed since JuliaLang#12839, nearly a year ago.
Updated the parallel docs to reflect this fact and to correspond
more closely with the current state of `multi.jl` and `managers.jl`.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs This change adds or pertains to documentation parallelism Parallel or distributed computation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants