-
Notifications
You must be signed in to change notification settings - Fork 477
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add local cluster #1403
Add local cluster #1403
Conversation
Codecov ReportAttention:
Additional details and impacted files@@ Coverage Diff @@
## main #1403 +/- ##
===========================================
- Coverage 80.33% 67.12% -13.22%
===========================================
Files 95 103 +8
Lines 6602 7272 +670
===========================================
- Hits 5304 4881 -423
- Misses 1298 2391 +1093 ☔ View full report in Codecov by Sentry. |
superduperdb/base/config.py
Outdated
None: Run all jobs in local mode i.e simple function call | ||
local: same as above | ||
dask+thread: Run all jobs on a local threaded dask cluster | ||
dask+tcp:<host>:<port>: Run all jobs on a remote dask cluster |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks inconsistent with the above. Please make uniform.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what do u mean?
can u write the edited version here :)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should be:
"local": same as above
superduperdb/base/config.py
Outdated
None: Run vector search on local | ||
http://<host>:<port>: Connect a remote vector search service | ||
|
||
`cdc` options: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What not add these in the parameter doc-strings?
superduperdb/base/config.py
Outdated
:param backfill_batch_size: The number of rows to backfill at a time | ||
for vector-search loading | ||
:param compute: The URI for compute i.e 'local', 'dask+tcp://localhost:8786' | ||
None: Run all jobs in local mode i.e simple function call |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The ':' at the end is confusing -- is that part of the string or part of the explanation. You need to add "quotation" marks.
Description
fix ##1379
Related Issues
Checklist
make test
successfully?Additional Notes or Comments