Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add NVIDIA_L4 to AcceleratorType #4216

Merged
merged 3 commits into from
Apr 28, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions packages/google-cloud-aiplatform/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -119,6 +119,7 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
| Endpoint_service.deploy_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.deploy_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.deploy_model.js,samples/README.md) |
| Endpoint_service.get_endpoint | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.get_endpoint.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.get_endpoint.js,samples/README.md) |
| Endpoint_service.list_endpoints | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.list_endpoints.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.list_endpoints.js,samples/README.md) |
| Endpoint_service.mutate_deployed_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.mutate_deployed_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.mutate_deployed_model.js,samples/README.md) |
| Endpoint_service.undeploy_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.undeploy_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.undeploy_model.js,samples/README.md) |
| Endpoint_service.update_endpoint | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.update_endpoint.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/endpoint_service.update_endpoint.js,samples/README.md) |
| Featurestore_online_serving_service.read_feature_values | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/featurestore_online_serving_service.read_feature_values.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/featurestore_online_serving_service.read_feature_values.js,samples/README.md) |
Expand Down Expand Up @@ -330,6 +331,7 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
| Endpoint_service.deploy_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.deploy_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.deploy_model.js,samples/README.md) |
| Endpoint_service.get_endpoint | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.get_endpoint.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.get_endpoint.js,samples/README.md) |
| Endpoint_service.list_endpoints | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.list_endpoints.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.list_endpoints.js,samples/README.md) |
| Endpoint_service.mutate_deployed_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.mutate_deployed_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.mutate_deployed_model.js,samples/README.md) |
| Endpoint_service.undeploy_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.undeploy_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.undeploy_model.js,samples/README.md) |
| Endpoint_service.update_endpoint | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.update_endpoint.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/endpoint_service.update_endpoint.js,samples/README.md) |
| Featurestore_online_serving_service.read_feature_values | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/featurestore_online_serving_service.read_feature_values.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/featurestore_online_serving_service.read_feature_values.js,samples/README.md) |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,9 @@ enum AcceleratorType {
// Nvidia Tesla A100 GPU.
NVIDIA_TESLA_A100 = 8;

// Nvidia L4 GPU.
NVIDIA_L4 = 11;

// TPU v2.
TPU_V2 = 6;

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -446,9 +446,9 @@ message BatchPredictionJob {

// For custom-trained Models and AutoML Tabular Models, the container of the
// DeployedModel instances will send `stderr` and `stdout` streams to
// Stackdriver Logging by default. Please note that the logs incur cost,
// Cloud Logging by default. Please note that the logs incur cost,
// which are subject to [Cloud Logging
// pricing](https://cloud.google.com/stackdriver/pricing).
// pricing](https://cloud.google.com/logging/pricing).
//
// User can disable container logging by setting this flag to true.
bool disable_container_logging = 34;
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -216,6 +216,26 @@ message CustomJobSpec {
// (within
// [HyperparameterTuningJob.trials][google.cloud.aiplatform.v1.HyperparameterTuningJob.trials]).
bool enable_dashboard_access = 16 [(google.api.field_behavior) = OPTIONAL];

// Optional. The Experiment associated with this job.
// Format:
// `projects/{project}/locations/{location}/metadataStores/{metadataStores}/contexts/{experiment-name}`
string experiment = 17 [
(google.api.field_behavior) = OPTIONAL,
(google.api.resource_reference) = {
type: "aiplatform.googleapis.com/Context"
}
];

// Optional. The Experiment Run associated with this job.
// Format:
// `projects/{project}/locations/{location}/metadataStores/{metadataStores}/contexts/{experiment-name}-{experiment-run-name}`
string experiment_run = 18 [
(google.api.field_behavior) = OPTIONAL,
(google.api.resource_reference) = {
type: "aiplatform.googleapis.com/Context"
}
];
}

// Represents the spec of a worker pool in a job.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -90,7 +90,7 @@ message Dataset {
map<string, string> labels = 7;

// All SavedQueries belong to the Dataset will be returned in List/Get
// Dataset response. The [annotation_specs][SavedQuery.annotation_specs] field
// Dataset response. The annotation_specs field
// will not be populated except for UI cases which will only use
// [annotation_spec_count][google.cloud.aiplatform.v1.SavedQuery.annotation_spec_count].
// In CreateDataset request, a SavedQuery is created together if
Expand Down Expand Up @@ -176,9 +176,9 @@ message ExportDataConfig {
ExportFractionSplit fraction_split = 5;
}

// A filter on Annotations of the Dataset. Only Annotations on to-be-exported
// DataItems(specified by [data_items_filter][]) that match this filter will
// be exported. The filter syntax is the same as in
// An expression for filtering what part of the Dataset is to be exported.
// Only Annotations that match this filter will be exported. The filter syntax
// is the same as in
// [ListAnnotations][google.cloud.aiplatform.v1.DatasetService.ListAnnotations].
string annotations_filter = 2;
}
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ message Endpoint {
option (google.api.resource) = {
type: "aiplatform.googleapis.com/Endpoint"
pattern: "projects/{project}/locations/{location}/endpoints/{endpoint}"
pattern: "projects/{project}/locations/{location}/publishers/{publisher}/models/{model}"
};

// Output only. The resource name of the Endpoint.
Expand Down Expand Up @@ -127,7 +128,8 @@ message Endpoint {

// Output only. Resource name of the Model Monitoring job associated with this
// Endpoint if monitoring is enabled by
// [CreateModelDeploymentMonitoringJob][]. Format:
// [JobService.CreateModelDeploymentMonitoringJob][google.cloud.aiplatform.v1.JobService.CreateModelDeploymentMonitoringJob].
// Format:
// `projects/{project}/locations/{location}/modelDeploymentMonitoringJobs/{model_deployment_monitoring_job}`
string model_deployment_monitoring_job = 14 [
(google.api.field_behavior) = OUTPUT_ONLY,
Expand Down Expand Up @@ -223,19 +225,19 @@ message DeployedModel {

// For custom-trained Models and AutoML Tabular Models, the container of the
// DeployedModel instances will send `stderr` and `stdout` streams to
// Stackdriver Logging by default. Please note that the logs incur cost,
// Cloud Logging by default. Please note that the logs incur cost,
// which are subject to [Cloud Logging
// pricing](https://cloud.google.com/stackdriver/pricing).
// pricing](https://cloud.google.com/logging/pricing).
//
// User can disable container logging by setting this flag to true.
bool disable_container_logging = 15;

// If true, online prediction access logs are sent to StackDriver
// If true, online prediction access logs are sent to Cloud
// Logging.
// These logs are like standard server access logs, containing
// information like timestamp and latency for each prediction request.
//
// Note that Stackdriver logs may incur a cost, especially if your project
// Note that logs may incur a cost, especially if your project
// receives prediction requests at a high queries per second rate (QPS).
// Estimate your costs before enabling this option.
bool enable_access_logging = 13;
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -122,6 +122,24 @@ service EndpointService {
metadata_type: "UndeployModelOperationMetadata"
};
}

// Updates an existing deployed model. Updatable fields include
// `min_replica_count`, `max_replica_count`, `autoscaling_metric_specs`,
// `disable_container_logging` (v1 only), and `enable_container_logging`
// (v1beta1 only).
rpc MutateDeployedModel(MutateDeployedModelRequest)
returns (google.longrunning.Operation) {
option (google.api.http) = {
post: "/v1/{endpoint=projects/*/locations/*/endpoints/*}:mutateDeployedModel"
body: "*"
};
option (google.api.method_signature) =
"endpoint,deployed_model,update_mask";
option (google.longrunning.operation_info) = {
response_type: "MutateDeployedModelResponse"
metadata_type: "MutateDeployedModelOperationMetadata"
};
}
}

// Request message for
Expand Down Expand Up @@ -358,3 +376,50 @@ message UndeployModelOperationMetadata {
// The operation generic information.
GenericOperationMetadata generic_metadata = 1;
}

// Request message for
// [EndpointService.MutateDeployedModel][google.cloud.aiplatform.v1.EndpointService.MutateDeployedModel].
message MutateDeployedModelRequest {
// Required. The name of the Endpoint resource into which to mutate a
// DeployedModel. Format:
// `projects/{project}/locations/{location}/endpoints/{endpoint}`
string endpoint = 1 [
(google.api.field_behavior) = REQUIRED,
(google.api.resource_reference) = {
type: "aiplatform.googleapis.com/Endpoint"
}
];

// Required. The DeployedModel to be mutated within the Endpoint. Only the
// following fields can be mutated:
//
// * `min_replica_count` in either
// [DedicatedResources][google.cloud.aiplatform.v1.DedicatedResources] or
// [AutomaticResources][google.cloud.aiplatform.v1.AutomaticResources]
// * `max_replica_count` in either
// [DedicatedResources][google.cloud.aiplatform.v1.DedicatedResources] or
// [AutomaticResources][google.cloud.aiplatform.v1.AutomaticResources]
// * [autoscaling_metric_specs][google.cloud.aiplatform.v1.DedicatedResources.autoscaling_metric_specs]
// * `disable_container_logging` (v1 only)
// * `enable_container_logging` (v1beta1 only)
DeployedModel deployed_model = 2 [(google.api.field_behavior) = REQUIRED];

// Required. The update mask applies to the resource. See
// [google.protobuf.FieldMask][google.protobuf.FieldMask].
google.protobuf.FieldMask update_mask = 4
[(google.api.field_behavior) = REQUIRED];
}

// Response message for
// [EndpointService.MutateDeployedModel][google.cloud.aiplatform.v1.EndpointService.MutateDeployedModel].
message MutateDeployedModelResponse {
// The DeployedModel that's being mutated.
DeployedModel deployed_model = 1;
}

// Runtime operation information for
// [EndpointService.MutateDeployedModel][google.cloud.aiplatform.v1.EndpointService.MutateDeployedModel].
message MutateDeployedModelOperationMetadata {
// The operation generic information.
GenericOperationMetadata generic_metadata = 1;
}
Original file line number Diff line number Diff line change
Expand Up @@ -88,4 +88,11 @@ message EntityType {
// disabled.
FeaturestoreMonitoringConfig monitoring_config = 8
[(google.api.field_behavior) = OPTIONAL];

// Optional. Config for data retention policy in offline storage.
// TTL in days for feature values that will be stored in offline storage.
// The Feature Store offline storage periodically removes obsolete feature
// values older than `offline_storage_ttl_days` since the feature generation
// time. If unset (or explicitly set to 0), default to 4000 days TTL.
int32 offline_storage_ttl_days = 10 [(google.api.field_behavior) = OPTIONAL];
}
Original file line number Diff line number Diff line change
Expand Up @@ -103,10 +103,6 @@ message EvaluatedAnnotation {
// ModelEvaluation. The EvaluatedDataItemView consists of all ground truths
// and predictions on
// [data_item_payload][google.cloud.aiplatform.v1.EvaluatedAnnotation.data_item_payload].
//
// Can be passed in
// [GetEvaluatedDataItemView's][ModelService.GetEvaluatedDataItemView][]
// [id][GetEvaluatedDataItemViewRequest.id].
string evaluated_data_item_view_id = 6
[(google.api.field_behavior) = OUTPUT_ONLY];

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -420,8 +420,8 @@ message BlurBaselineConfig {
// explanation][google.cloud.aiplatform.v1.PredictionService.Explain] time.
message ExplanationSpecOverride {
// The parameters to be overridden. Note that the
// [method][google.cloud.aiplatform.v1.ExplanationParameters.method] cannot be
// changed. If not specified, no parameter is overridden.
// attribution method cannot be changed. If not specified,
// no parameter is overridden.
ExplanationParameters parameters = 1;

// The metadata to be overridden. If not specified, no metadata is overridden.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,10 +38,11 @@ message Feature {
pattern: "projects/{project}/locations/{location}/featurestores/{featurestore}/entityTypes/{entity_type}/features/{feature}"
};

// A list of historical [Snapshot
// Analysis][FeaturestoreMonitoringConfig.SnapshotAnalysis] or [Import Feature
// Analysis] [FeaturestoreMonitoringConfig.ImportFeatureAnalysis] stats
// requested by user, sorted by
// A list of historical
// [SnapshotAnalysis][google.cloud.aiplatform.v1.FeaturestoreMonitoringConfig.SnapshotAnalysis]
// or
// [ImportFeaturesAnalysis][google.cloud.aiplatform.v1.FeaturestoreMonitoringConfig.ImportFeaturesAnalysis]
// stats requested by user, sorted by
// [FeatureStatsAnomaly.start_time][google.cloud.aiplatform.v1.FeatureStatsAnomaly.start_time]
// descending.
message MonitoringStatsAnomaly {
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -138,6 +138,14 @@ message Featurestore {
// Output only. State of the featurestore.
State state = 8 [(google.api.field_behavior) = OUTPUT_ONLY];

// Optional. TTL in days for feature values that will be stored in online
// serving storage. The Feature Store online storage periodically removes
// obsolete feature values older than `online_storage_ttl_days` since the
// feature generation time. Note that `online_storage_ttl_days` should be less
// than or equal to `offline_storage_ttl_days` for each EntityType under a
// featurestore. If not set, default to 4000 days
int32 online_storage_ttl_days = 13 [(google.api.field_behavior) = OPTIONAL];

// Optional. Customer-managed encryption key spec for data storage. If set,
// both of the online and offline data storage will be secured by this key.
EncryptionSpec encryption_spec = 10 [(google.api.field_behavior) = OPTIONAL];
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -162,7 +162,7 @@ message ReadFeatureValuesResponse {
}];

// List of Feature metadata corresponding to each piece of
// [ReadFeatureValuesResponse.data][].
// [ReadFeatureValuesResponse.EntityView.data][google.cloud.aiplatform.v1.ReadFeatureValuesResponse.EntityView.data].
repeated FeatureDescriptor feature_descriptors = 2;
}

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -464,7 +464,7 @@ message UpdateFeaturestoreRequest {
// * `labels`
// * `online_serving_config.fixed_node_count`
// * `online_serving_config.scaling`
// * `online_storage_ttl_days` (available in Preview)
// * `online_storage_ttl_days`
google.protobuf.FieldMask update_mask = 2;
}

Expand Down Expand Up @@ -927,7 +927,7 @@ message UpdateEntityTypeRequest {
// * `monitoring_config.import_features_analysis.anomaly_detection_baseline`
// * `monitoring_config.numerical_threshold_config.value`
// * `monitoring_config.categorical_threshold_config.value`
// * `offline_storage_ttl_days` (available in Preview)
// * `offline_storage_ttl_days`
google.protobuf.FieldMask update_mask = 2;
}

Expand Down
Loading