Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Support GPU blocks #1780

Open
Tracked by #1782
peterschmidt85 opened this issue Oct 3, 2024 · 2 comments
Open
Tracked by #1782

[Feature] Support GPU blocks #1780

peterschmidt85 opened this issue Oct 3, 2024 · 2 comments
Assignees
@un-def
Labels
feature major

Comments

@peterschmidt85
Copy link
Contributor

peterschmidt85 commented Oct 3, 2024 •
edited
Loading

Motivation and implementation notes: https://docs.google.com/document/d/1-0cInSwV3CkybQUi4w4KtsrkFw5grvYdKxGo0gqPh2w/edit?usp=sharing
@peterschmidt85 peterschmidt85 mentioned this issue Oct 3, 2024
Open
49 tasks
@james-boydell james-boydell mentioned this issue Oct 17, 2024
Closed
@github-actions GitHub Actions
Copy link

github-actions bot commented Nov 3, 2024

This issue is stale because it has been open for 30 days with no activity.

@github-actions github-actions bot added the stale label Nov 3, 2024
@github-actions GitHub Actions
Copy link

This issue was closed because it has been inactive for 14 days since being marked as stale. Please reopen the issue if it is still relevant.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Nov 17, 2024
@peterschmidt85 peterschmidt85 changed the title [Feature] Run multiple jobs concurrently on one instance with a fraction of resources GPU/RAM/disk [Feature] Support GPU blocks Nov 17, 2024
@peterschmidt85 peterschmidt85 pinned this issue Dec 2, 2024
un-def added a commit that referenced this issue Dec 10, 2024
@un-def
[shim] Implement multi-task state
3367301 
The shim is now able to process multiple tasks at a time.
The global state for the existing "legacy" API is emulated.
From the API caller's point of view, the shim works exactly
the same as before.

Part-of: #1780
@un-def un-def mentioned this issue Dec 10, 2024
Merged
un-def added a commit that referenced this issue Dec 10, 2024
@un-def
[shim] Implement multi-task state
dd8e549 
The shim is now able to process multiple tasks at a time.
The global state for the existing "legacy" API is emulated.
From the API caller's point of view, the shim works exactly
the same as before.

Part-of: #1780
un-def added a commit that referenced this issue Dec 12, 2024
@un-def
[shim] Implement multi-task state (#2078)
d235052 
The shim is now able to process multiple tasks at a time.
The global state for the existing "legacy" API is emulated.
From the API caller's point of view, the shim works exactly
the same as before.

Part-of: #1780
un-def added a commit that referenced this issue Dec 13, 2024
@un-def
[shim] Rework resource management
178f801 
* Collect GPU resource identifiers: UUIDs for NVIDIA, DRI render nodes
  for AMD
* Request GPUs by identifiers when creating a container
* Keep track of busy/idle GPUs
* Move host-related code to a separate package
* Don't `panic()`

Part-of: #1780
@un-def un-def mentioned this issue Dec 13, 2024
Open
@un-def un-def added the major label Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@un-def un-def

Labels
feature major
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@un-def @peterschmidt85