docs: release notes & updates for Kubernetes pods to jobs #9443
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
carolinaecalderon
changed the base branch from
main
to
stoksc/feat/kubernetesjobs
✅ Deploy Preview for determined-ui ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## stoksc/feat/kubernetesjobs #9443 +/- ##
==============================================================
- Coverage 49.04% 49.04% -0.01%
==============================================================
Files 1233 1233
Lines 159205 159205
Branches 2778 2777 -1
==============================================================
- Hits 78084 78076 -8
- Misses 80947 80955 +8
Partials 174 174
Flags with carried forward coverage won't be shown. Click here to find out more. |
tara-det-ai
reviewed
May 29, 2024
tara-det-ai
approved these changes
May 29, 2024
stoksc
approved these changes
May 29, 2024
carolinaecalderon
merged commit 42ead04
into
stoksc/feat/kubernetesjobs
80 of 95 checks passed
4 tasks
stoksc
added a commit
that referenced
this pull request
May 31, 2024
This change updates the Kubernetes resource manager to submit one Kubernetes job per Determined allocation instead of many pods. This is complicated but we think it is worth it because: - Jobs play nice with resource quotas and other Kubernetes features out of the box. - Eventually we can delegate restarts, TTL, pause/resume (using suspend), and more to jobs. - They allow us to better integrate with Kueue and other tools in the ml ecosystem. - Supporting VolcanoJobs (or similar alternatives) alongside Jobs is realistic. - The refactor is net positive w.r.t. test coverage (20% to 80%) and code quality. This commit is the result of several PRs, enumerated here for easier discovery. - #9296 contains most of the code changes. - #9443 - #9447 - #9450 - #9451 Co-authored-by: Carolina Calderon <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Ticket
RM-258
Description
Include release note & updates to Kubernetes docs for the pods to jobs project.
Test Plan
N/A
Checklist
docs/release-notes/.See Release Note for details.