Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update Dockerfile-CUDA #5689

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from

Conversation

feederbox826
Copy link
Contributor

supercedes #5582

@WithoutPants WithoutPants added the chore Pull requests for refactoring and admin work label Feb 28, 2025
@WithoutPants WithoutPants added this to the Version 0.28.0 milestone Feb 28, 2025
@dongfengweixiao
Copy link
Contributor

Configuring the CUDA version to 12.8.0 is quite progressive, and this might pose an issue as some host machines are not capable of installing such a recent NVIDIA driver version. This can lead to users who have downloaded the image being unable to utilize it effectively. A case in point is the Synology system, where third-party NVIDIA drivers are available in version 535.154.05, compatible with CUDA version 12.2. So, do you guess why my pull request doesn’t use a higher version of Ubuntu? Is it because I don’t want to? No, it’s because I can’t!

➜  ~ nvidia-smi
Fri Feb 28 22:22:31 2025       
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.154.05             Driver Version: 535.154.05   CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce GTX 750 Ti      On  | 00000000:01:00.0 Off |                  N/A |
| 33%   15C    P8               1W /  46W |      0MiB /  2048MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
                                                                                         
+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|  No running processes found                                                           |
+---------------------------------------------------------------------------------------+

@feederbox826
Copy link
Contributor Author

It's a manual image, you can build it yourself if your upstream package doesn't support the latest drivers.

12.2 has reached EOL (R535-R549). Per the container support policy, we should bump to latest to avoid disruptions and deleted upstream images

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
chore Pull requests for refactoring and admin work
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants