Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RayJob] Add runtime env YAML field #1338

Merged
merged 17 commits into from
Aug 22, 2023

Conversation

architkulkarni
Copy link
Contributor

@architkulkarni architkulkarni commented Aug 16, 2023

Why are these changes needed?

Adds the field RuntimeEnvYAML to the RayJob CRD which accepts a multi-line YAML string. This format is preferred for two reasons:

  • Consistency with the ServeConfigV2 format, which is also a Ray configuration specified as a multi-line YAML string
  • (Related to above) Allows using snake_case fields without modification

We preserve the older field RuntimeEnv which accepts a base64-encoded string of the runtime env. We mark it as deprecated in the documentation.

We raise an error if both fields are specified.

Related issue number

Closes #1195

Checks

  • I've made sure the tests are passing.
  • Testing Strategy
    • Unit tests
    • Manual tests
    • This PR is not tested :(

Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
@architkulkarni architkulkarni marked this pull request as ready for review August 16, 2023 21:04
Signed-off-by: Archit Kulkarni <[email protected]>
Copy link
Member

@kevin85421 kevin85421 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would you mind rebasing your branch with the upstream master? The master branch has a new RayJob YAML file. Thanks!

ray-operator/controllers/ray/common/job.go Show resolved Hide resolved
Copy link
Member

@kevin85421 kevin85421 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@architkulkarni architkulkarni merged commit 5de4a42 into ray-project:master Aug 22, 2023
blublinsky pushed a commit to blublinsky/kuberay that referenced this pull request Aug 25, 2023
Adds the field RuntimeEnvYAML to the RayJob CRD which accepts a multi-line YAML string. This format is preferred for two reasons:

Consistency with the ServeConfigV2 format, which is also a Ray configuration specified as a multi-line YAML string
(Related to above) Allows using snake_case fields without modification
We preserve the older field RuntimeEnv which accepts a base64-encoded string of the runtime env. We mark it as deprecated in the documentation.

We raise an error if both fields are specified.

Related issue number
Closes ray-project#1195

---------

Signed-off-by: Archit Kulkarni <[email protected]>
lowang-bh pushed a commit to lowang-bh/kuberay that referenced this pull request Sep 24, 2023
Adds the field RuntimeEnvYAML to the RayJob CRD which accepts a multi-line YAML string. This format is preferred for two reasons:

Consistency with the ServeConfigV2 format, which is also a Ray configuration specified as a multi-line YAML string
(Related to above) Allows using snake_case fields without modification
We preserve the older field RuntimeEnv which accepts a base64-encoded string of the runtime env. We mark it as deprecated in the documentation.

We raise an error if both fields are specified.

Related issue number
Closes ray-project#1195

---------

Signed-off-by: Archit Kulkarni <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature] Specify RuntimeEnv in RayJob via YAML instead of base64 encoded string
2 participants