Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Introduce DefaultRuntime to PipelineJob #5756

Merged
merged 4 commits into from
Oct 17, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -64,6 +64,44 @@ message PipelineJob {
}
}

// Persistent resource based runtime detail. For more information, refer to
// https://cloud.google.com/vertex-ai/docs/training/persistent-resource-overview
message PersistentResourceRuntimeDetail {
// An enum that specifies the behavior to take if the timeout is reached.
enum TaskResourceUnavailableTimeoutBehavior {
// Unspecified. Behavior is same as `FAIL`.
TASK_RESOURCE_UNAVAILABLE_TIMEOUT_BEHAVIOR_UNSPECIFIED = 0;

// Fail the task if the timeout is reached.
FAIL = 1;

// Fall back to on-demand execution if the timeout is reached.
FALL_BACK_TO_ON_DEMAND = 2;
}

// Persistent resource name.
// Format:
// `projects/{project}/locations/{location}/persistentResources/{persistent_resource}`
string persistent_resource_name = 1;

// The max time a pipeline task waits for the required CPU, memory, or
// accelerator resource to become available from the specified persistent
// resource. Default wait time is 0.
int64 task_resource_unavailable_wait_time_ms = 2;

// Specifies the behavior to take if the timeout is reached.
TaskResourceUnavailableTimeoutBehavior
task_resource_unavailable_timeout_behavior = 3;
}

// The default runtime for the PipelineJob.
message DefaultRuntime {
oneof runtime_detail {
// Persistent resource based runtime detail.
PersistentResourceRuntimeDetail persistent_resource_runtime_detail = 1;
}
}

// Deprecated. Use
// [RuntimeConfig.parameter_values][google.cloud.aiplatform.v1beta1.PipelineJob.RuntimeConfig.parameter_values]
// instead. The runtime parameters of the PipelineJob. The parameters will
Expand Down Expand Up @@ -103,6 +141,12 @@ message PipelineJob {
// The runtime artifacts of the PipelineJob. The key will be the input
// artifact name and the value would be one of the InputArtifact.
map<string, InputArtifact> input_artifacts = 5;

// Optional. The default runtime for the PipelineJob. If not provided,
// Vertex Custom Job(on demand) is used as the runtime. For Vertex Custom
// Job, please refer to
// https://cloud.google.com/vertex-ai/docs/training/overview.
DefaultRuntime default_runtime = 6 [(google.api.field_behavior) = OPTIONAL];
}

// Output only. The resource name of the PipelineJob.
Expand Down
225 changes: 225 additions & 0 deletions packages/google-cloud-aiplatform/protos/protos.d.ts

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading