-
Notifications
You must be signed in to change notification settings - Fork 554
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[k8s] GPU Image debloat #3665
[k8s] GPU Image debloat #3665
Conversation
Updated CUDA image to 12.1.1 since that will be supported till Feb 2025, and is at parity with cu121 offered on GCP. Running smoke tests again. EDIT - smoke tests pass - |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for reducing the GPU image @romilbhardwaj! LGTM.
Thanks @Michaelvll! Will merge after skypilot-org/skypilot-catalog#72 is approved and merged. |
* optimize GPU image * revert changes * add kubectl to cpu image * add git to dependencies * fixes and parity b/w cpu and gpu images * comments
Optimizes the Kubernetes GPU image for >2x faster provisioning (87s vs 201s). The new image is 1.96G compressed vs 6.39G compressed for the previous image.
Also adds kubectl to the dependencies pre-installed in the image for faster controller setup.
Closes #3435 and #2461.
Related - skypilot-org/skypilot-catalog#72
Tested: