Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Current Main Does Not Work On Python3.8 #6033

Closed
robertgshaw2-redhat opened this issue Jul 1, 2024 · 1 comment · Fixed by #6039
Closed

[Bug]: Current Main Does Not Work On Python3.8 #6033

robertgshaw2-redhat opened this issue Jul 1, 2024 · 1 comment · Fixed by #6039
Labels
bug Something isn't working

Comments

@robertgshaw2-redhat
Copy link
Collaborator

robertgshaw2-redhat commented Jul 1, 2024

Your current environment

The output of `python collect_env.py`

🐛 Describe the bug

SUMMARY:

  • Install on python 3.8
  • run from vllm import LLM
    Fails with:
  File "<string>", line 1, in <module>
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/__init__.py", line 4, in <module>
    from vllm.engine.async_llm_engine import AsyncLLMEngine
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/async_llm_engine.py", line 14, in <module>
    from vllm.engine.llm_engine import LLMEngine
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/llm_engine.py", line 18, in <module>
    from vllm.engine.output_processor.interfaces import (
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/output_processor/interfaces.py", line 10, in <module>
    from vllm.transformers_utils.detokenizer import Detokenizer
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/detokenizer.py", line 6, in <module>
    from vllm.transformers_utils.tokenizer_group.base_tokenizer_group import (
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/tokenizer_group/__init__.py", line 11, in <module>
    from vllm.transformers_utils.tokenizer_group.ray_tokenizer_group import (
  File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/tokenizer_group/ray_tokenizer_group.py", line 5, in <module>
    from ray.exceptions import ActorDiedError

Simple reproduction:

from ray.exceptions import ActorDiedError

Fails with:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name 'ActorDiedError' from 'ray.exceptions' (/home/rshaw/.pyenv/versions/nm-vllm-src-3.8/lib/python3.8/site-packages/ray/exceptions.py)
@robertgshaw2-redhat robertgshaw2-redhat added the bug Something isn't working label Jul 1, 2024
@DarkLight1337
Copy link
Member

Same as #5861

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants