You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
File "<string>", line 1, in<module>
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/__init__.py", line 4, in<module>
from vllm.engine.async_llm_engine import AsyncLLMEngine
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/async_llm_engine.py", line 14, in<module>
from vllm.engine.llm_engine import LLMEngine
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/llm_engine.py", line 18, in<module>
from vllm.engine.output_processor.interfaces import (
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/engine/output_processor/interfaces.py", line 10, in<module>
from vllm.transformers_utils.detokenizer import Detokenizer
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/detokenizer.py", line 6, in<module>
from vllm.transformers_utils.tokenizer_group.base_tokenizer_group import (
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/tokenizer_group/__init__.py", line 11, in<module>
from vllm.transformers_utils.tokenizer_group.ray_tokenizer_group import (
File "/home/runner/_work/_tool/Python/3.8.17/x64/lib/python3.8/site-packages/vllm/transformers_utils/tokenizer_group/ray_tokenizer_group.py", line 5, in<module>
from ray.exceptions import ActorDiedError
Simple reproduction:
fromray.exceptionsimportActorDiedError
Fails with:
Traceback (most recent call last):
File "<stdin>", line 1, in<module>
ImportError: cannot import name 'ActorDiedError' from 'ray.exceptions' (/home/rshaw/.pyenv/versions/nm-vllm-src-3.8/lib/python3.8/site-packages/ray/exceptions.py)
The text was updated successfully, but these errors were encountered:
Your current environment
🐛 Describe the bug
SUMMARY:
from vllm import LLM
Fails with:
Simple reproduction:
Fails with:
The text was updated successfully, but these errors were encountered: