-
Notifications
You must be signed in to change notification settings - Fork 94
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Clarify memory_limit
docs
#1207
Clarify memory_limit
docs
#1207
Conversation
(bytes), float (fraction of total system memory), string (like ``"5GB"`` or | ||
``"5000M"``), or ``"auto"`` or 0 for no memory management.""", | ||
help="""Size of the host LRU cache, which is used to determine when the worker | ||
starts spilling to disk (not available if JIT-Unspill is enabled). Can be an |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is there any dependency between memory-limit and device-memory-limit, that should be set? like if one cannot be bigger than other etc..
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
memory-limit
and device-memory-limit
are independent
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @pentschev
Thanks everyone for reviews. @rnyak if you have further suggestions to improve phrasing, please feel free to open an issue or a PR with changes. |
/merge |
It's not currently clear what is the purpose of
memory_limit
/--memory-limit
. This attempts to clarify it's used to spill from host memory to disk.