Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upload_collection can't be launched with parallel and without explicit ids #459

Closed
joein opened this issue Jan 24, 2024 · 0 comments
Closed
Assignees
Labels
bug Something isn't working

Comments

@joein
Copy link
Member

joein commented Jan 24, 2024

cl.upload_collection('test1', vectors=[[1.0, 0.2], [0.1, 0.2], [0.3, 0.4], [0.2, 0.1], [0.1, 0.2]], batch_size=2, parallel=3)
Traceback (most recent call last):
  File "/Users/x/.pyenv/versions/3.10.12/lib/python3.10/multiprocessing/queues.py", line 244, in _feed
    obj = _ForkingPickler.dumps(obj)
  File "/Users/x/.pyenv/versions/3.10.12/lib/python3.10/multiprocessing/reduction.py", line 51, in dumps
    cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'generator' object
Traceback (most recent call last):
  File "/Users/x/.pyenv/versions/3.10.12/lib/python3.10/multiprocessing/queues.py", line 244, in _feed
    obj = _ForkingPickler.dumps(obj)
  File "/Users/x/.pyenv/versions/3.10.12/lib/python3.10/multiprocessing/reduction.py", line 51, in dumps
    cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'generator' object
Traceback (most recent call last):
  File "/Users/x/.pyenv/versions/3.10.12/lib/python3.10/multiprocessing/queues.py", line 244, in _feed
    obj = _ForkingPickler.dumps(obj)
  File "/Users/x/.pyenv/versions/3.10.12/lib/python3.10/multiprocessing/reduction.py", line 51, in dumps
    cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'generator' object
@joein joein added the bug Something isn't working label Jan 24, 2024
@joein joein changed the title upload_collection id generator can't be launched in parallel upload_collection can't be launched with parallel and without explicit ids Jan 24, 2024
@joein joein self-assigned this Jan 25, 2024
@joein joein closed this as completed Jan 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant