Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rework GPU API #2821

Merged
merged 1 commit into from
Apr 27, 2024
Merged

Conversation

RunDevelopment
Copy link
Member

Follow up to #2790.

This PR reworks our GPU API around pynvml to be easier to work with and more error resistant. The main change is that the gpu module now exports a single nvidia object. This object simply holds a list of all Nvidia devices. If the list is empty, then nvidia.is_available is false. This gives us a pretty simple OO API, which closely models the nvml API.

@joeyballentine joeyballentine merged commit 6114869 into chaiNNer-org:main Apr 27, 2024
14 checks passed
@RunDevelopment RunDevelopment deleted the gpu-api-rework branch April 27, 2024 17:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants