You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
× CUDA version 12.3 is not compatible with TensorRT-LLM models. Required version: 12.4
3.Install latest cuda toolkit
4. Get the same message
5. Realize also need to install Nvidia Driver (is that where we're checking cuda version?)
6. Issue resolved.
Success Criteria
Low hanging fruit is to just give a better error message:
Your Nvidia Driver and Cuda Toolkit is not compatible with the latest TRT-LLM Models.
Please download the latest: NVIDIA driver version ___ or higher. CUDA Toolkit version ___ or higher.
Additional context
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered:
dan-menlo
changed the title
feat: Better error logs for Cuda/Nvidia driver out of date
feat: TensorRT-LLM better error logs for Cuda/Nvidia driver out of date
Sep 8, 2024
Problem
3.Install latest cuda toolkit
4. Get the same message
5. Realize also need to install Nvidia Driver (is that where we're checking cuda version?)
6. Issue resolved.
Success Criteria
Low hanging fruit is to just give a better error message:
Your Nvidia Driver and Cuda Toolkit is not compatible with the latest TRT-LLM Models.
Please download the latest:
NVIDIA driver version ___ or higher.
CUDA Toolkit version ___ or higher.
Additional context
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered: