feat: add disable_container_logging to BatchPredictionJob in aiplatfo…

…rm v1,v1beta1 batch_prediction_job.proto (#4052)

* feat: add TPU_V4_POD to AcceleratorType in aiplatform v1beta1 accelerator_type.proto
feat: add split to ExportDataConfig in aiplatform v1beta1 dataset.proto
feat: add evaluated_annotation.proto to aiplatform v1beta1
feat: add cpu_utilization_target to Featurestore.OnlineServingConfig.Scaling in aiplatform v1beta1 featurestore.proto
feat: add large_model_reference to Model in aiplatform v1beta1 model.proto
feat: add slice_spec to ModelEvaluationSlice in aiplatform v1beta1 model_evaluation_slice.proto
feat: add BatchImportEvaluatedAnnotations rpc to aiplatform v1beta1 model_service.proto
docs: deprecated enable_restricted_image_training in NasJob in aiplatform v1beta1 nas_job.proto

PiperOrigin-RevId: 513669538

Source-Link: googleapis/googleapis@01293cf

Source-Link: googleapis/googleapis-gen@b79c29a
Copy-Tag: eyJwIjoicGFja2FnZXMvZ29vZ2xlLWNsb3VkLWFpcGxhdGZvcm0vLk93bEJvdC55YW1sIiwiaCI6ImI3OWMyOWFjZWYyZTUzZDNjNTEzYzUxYjY0ZTliNzU5YTZjZTUyMzMifQ==

* feat: add TPU_V4_POD to AcceleratorType in aiplatform v1 accelerator_type.proto
feat: add split to ExportDataConfig in aiplatform v1 dataset.proto
feat: add offline_storage_ttl_days to EntityType in aiplatform v1 entity_type.proto
feat: add evaluated_annotation.proto to aiplatform v1
feat: add cpu_utilization_target to Featurestore.OnlineServingConfig.Scaling in aiplatform v1 featurestore.proto
feat: add online_storage_ttl_days to Featurestore in aiplatform v1 featurestore.proto
feat: add slice_spec to ModelEvaluationSlice in aiplatform v1 model_evaluation_slice.proto
feat: add BatchImportEvaluatedAnnotations rpc to aiplatform v1 model_service.proto

PiperOrigin-RevId: 513671267

Source-Link: googleapis/googleapis@daccff8

Source-Link: googleapis/googleapis-gen@9ff0226
Copy-Tag: eyJwIjoicGFja2FnZXMvZ29vZ2xlLWNsb3VkLWFpcGxhdGZvcm0vLk93bEJvdC55YW1sIiwiaCI6IjlmZjAyMjY5MTBmMjE2NmE2MGJiOTIwMjE5ZGM3N2U2YmU3MGJkNWMifQ==

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* feat: add disable_container_logging to BatchPredictionJob in aiplatform v1,v1beta1 batch_prediction_job.proto

PiperOrigin-RevId: 513711185

Source-Link: googleapis/googleapis@4a6262f

Source-Link: googleapis/googleapis-gen@e1c1bb6
Copy-Tag: eyJwIjoicGFja2FnZXMvZ29vZ2xlLWNsb3VkLWFpcGxhdGZvcm0vLk93bEJvdC55YW1sIiwiaCI6ImUxYzFiYjY1ZGQwYmViNzk1MzQzZDBiYjk2NzhkNWYyNTY1OGE2OTIifQ==

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

---------

Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
Co-authored-by: danieljbruce <[email protected]>

packages/google-cloud-aiplatform/README.md

@@ -131,6 +131,7 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
 | Featurestore_service.create_featurestore | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.create_featurestore.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.create_featurestore.js,samples/README.md) |
 | Featurestore_service.delete_entity_type | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.delete_entity_type.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.delete_entity_type.js,samples/README.md) |
 | Featurestore_service.delete_feature | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.delete_feature.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.delete_feature.js,samples/README.md) |
+| Featurestore_service.delete_feature_values | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.delete_feature_values.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.delete_feature_values.js,samples/README.md) |
 | Featurestore_service.delete_featurestore | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.delete_featurestore.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.delete_featurestore.js,samples/README.md) |
 | Featurestore_service.export_feature_values | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.export_feature_values.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.export_feature_values.js,samples/README.md) |
 | Featurestore_service.get_entity_type | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.get_entity_type.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/featurestore_service.get_entity_type.js,samples/README.md) |
@@ -228,6 +229,7 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
 | Metadata_service.update_execution | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/metadata_service.update_execution.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/metadata_service.update_execution.js,samples/README.md) |
 | Migration_service.batch_migrate_resources | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/migration_service.batch_migrate_resources.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/migration_service.batch_migrate_resources.js,samples/README.md) |
 | Migration_service.search_migratable_resources | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/migration_service.search_migratable_resources.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/migration_service.search_migratable_resources.js,samples/README.md) |
+| Model_service.batch_import_evaluated_annotations | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/model_service.batch_import_evaluated_annotations.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/model_service.batch_import_evaluated_annotations.js,samples/README.md) |
 | Model_service.batch_import_model_evaluation_slices | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/model_service.batch_import_model_evaluation_slices.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/model_service.batch_import_model_evaluation_slices.js,samples/README.md) |
 | Model_service.copy_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/model_service.copy_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/model_service.copy_model.js,samples/README.md) |
 | Model_service.delete_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1/model_service.delete_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1/model_service.delete_model.js,samples/README.md) |
@@ -440,6 +442,7 @@ Samples are in the [`samples/`](https://github.com/googleapis/google-cloud-node/
 | Metadata_service.update_execution | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/metadata_service.update_execution.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/metadata_service.update_execution.js,samples/README.md) |
 | Migration_service.batch_migrate_resources | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/migration_service.batch_migrate_resources.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/migration_service.batch_migrate_resources.js,samples/README.md) |
 | Migration_service.search_migratable_resources | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/migration_service.search_migratable_resources.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/migration_service.search_migratable_resources.js,samples/README.md) |
+| Model_service.batch_import_evaluated_annotations | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/model_service.batch_import_evaluated_annotations.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/model_service.batch_import_evaluated_annotations.js,samples/README.md) |
 | Model_service.batch_import_model_evaluation_slices | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/model_service.batch_import_model_evaluation_slices.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/model_service.batch_import_model_evaluation_slices.js,samples/README.md) |
 | Model_service.copy_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/model_service.copy_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/model_service.copy_model.js,samples/README.md) |
 | Model_service.delete_model | [source code](https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-aiplatform/samples/generated/v1beta1/model_service.delete_model.js) | [![Open in Cloud Shell][shell_img]](https://console.cloud.google.com/cloudshell/open?git_repo=https://github.com/googleapis/google-cloud-node&page=editor&open_in_editor=packages/google-cloud-aiplatform/samples/generated/v1beta1/model_service.delete_model.js,samples/README.md) |

packages/google-cloud-aiplatform/protos/google/cloud/aiplatform/v1/accelerator_type.proto

@@ -25,6 +25,7 @@ option php_namespace = "Google\\Cloud\\AIPlatform\\V1";
 option ruby_package = "Google::Cloud::AIPlatform::V1";
 
 // Represents a hardware accelerator type.
+// NEXT ID: 11.
 enum AcceleratorType {
   // Unspecified accelerator type, which means no accelerator.
   ACCELERATOR_TYPE_UNSPECIFIED = 0;
@@ -52,4 +53,7 @@ enum AcceleratorType {
 
   // TPU v3.
   TPU_V3 = 7;
+
+  // TPU v4.
+  TPU_V4_POD = 10;
 }

packages/google-cloud-aiplatform/protos/google/cloud/aiplatform/v1/batch_prediction_job.proto

@@ -273,7 +273,11 @@ message BatchPredictionJob {
   // Exactly one of model and unmanaged_container_model must be set.
   //
   // The model resource name may contain version id or version alias to specify
-  // the version, if no version is specified, the default version will be used.
+  // the version.
+  //  Example: `projects/{project}/locations/{location}/models/{model}@2`
+  //              or
+  //            `projects/{project}/locations/{location}/models/{model}@golden`
+  // if no version is specified, the default version will be deployed.
   string model = 3 [(google.api.resource_reference) = {
     type: "aiplatform.googleapis.com/Model"
   }];
@@ -439,4 +443,13 @@ message BatchPredictionJob {
   // is set, then all resources created by the BatchPredictionJob will be
   // encrypted with the provided encryption key.
   EncryptionSpec encryption_spec = 24;
+
+  // For custom-trained Models and AutoML Tabular Models, the container of the
+  // DeployedModel instances will send `stderr` and `stdout` streams to
+  // Stackdriver Logging by default. Please note that the logs incur cost,
+  // which are subject to [Cloud Logging
+  // pricing](https://cloud.google.com/stackdriver/pricing).
+  //
+  // User can disable container logging by setting this flag to true.
+  bool disable_container_logging = 34;
 }

packages/google-cloud-aiplatform/protos/google/cloud/aiplatform/v1/dataset.proto

@@ -169,9 +169,33 @@ message ExportDataConfig {
     GcsDestination gcs_destination = 1;
   }
 
+  // The instructions how the export data should be split between the
+  // training, validation and test sets.
+  oneof split {
+    // Split based on fractions defining the size of each set.
+    ExportFractionSplit fraction_split = 5;
+  }
+
   // A filter on Annotations of the Dataset. Only Annotations on to-be-exported
   // DataItems(specified by [data_items_filter][]) that match this filter will
   // be exported. The filter syntax is the same as in
   // [ListAnnotations][google.cloud.aiplatform.v1.DatasetService.ListAnnotations].
   string annotations_filter = 2;
 }
+
+// Assigns the input data to training, validation, and test sets as per the
+// given fractions. Any of `training_fraction`, `validation_fraction` and
+// `test_fraction` may optionally be provided, they must sum to up to 1. If the
+// provided ones sum to less than 1, the remainder is assigned to sets as
+// decided by Vertex AI. If none of the fractions are set, by default roughly
+// 80% of data is used for training, 10% for validation, and 10% for test.
+message ExportFractionSplit {
+  // The fraction of the input data that is to be used to train the Model.
+  double training_fraction = 1;
+
+  // The fraction of the input data that is to be used to validate the Model.
+  double validation_fraction = 2;
+
+  // The fraction of the input data that is to be used to evaluate the Model.
+  double test_fraction = 3;
+}

packages/google-cloud-aiplatform/protos/google/cloud/aiplatform/v1/dataset_service.proto

@@ -27,6 +27,7 @@ import "google/cloud/aiplatform/v1/dataset.proto";
 import "google/cloud/aiplatform/v1/operation.proto";
 import "google/cloud/aiplatform/v1/saved_query.proto";
 import "google/longrunning/operations.proto";
+import "google/protobuf/empty.proto";
 import "google/protobuf/field_mask.proto";
 
 option csharp_namespace = "Google.Cloud.AIPlatform.V1";

packages/google-cloud-aiplatform/protos/google/cloud/aiplatform/v1/endpoint.proto

@@ -169,7 +169,11 @@ message DeployedModel {
   // Endpoint.
   //
   // The resource name may contain version id or version alias to specify the
-  // version, if no version is specified, the default version will be deployed.
+  // version.
+  //  Example: `projects/{project}/locations/{location}/models/{model}@2`
+  //              or
+  //            `projects/{project}/locations/{location}/models/{model}@golden`
+  // if no version is specified, the default version will be deployed.
   string model = 2 [
     (google.api.field_behavior) = REQUIRED,
     (google.api.resource_reference) = {

packages/google-cloud-aiplatform/protos/google/cloud/aiplatform/v1/endpoint_service.proto

@@ -23,6 +23,7 @@ import "google/api/resource.proto";
 import "google/cloud/aiplatform/v1/endpoint.proto";
 import "google/cloud/aiplatform/v1/operation.proto";
 import "google/longrunning/operations.proto";
+import "google/protobuf/empty.proto";
 import "google/protobuf/field_mask.proto";
 
 option csharp_namespace = "Google.Cloud.AIPlatform.V1";