Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: SDK support for model monitoring #1249

Merged
merged 83 commits into from
Jul 28, 2022
Merged
Show file tree
Hide file tree
Changes from 57 commits
Commits
Show all changes
83 commits
Select commit Hold shift + click to select a range
4c65bc2
feat: SDK support for model monitoring (for models deployed to endpoi…
rosiezou May 17, 2022
69b9a07
fixing syntax errors
rosiezou May 24, 2022
10a9201
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] May 24, 2022
1b6178f
resolving merge diff
rosiezou May 26, 2022
7eb3879
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] May 26, 2022
161abf2
removing sync parameter from MDM job
rosiezou May 29, 2022
4b46950
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] May 29, 2022
658e18e
fixing runtime errors
rosiezou Jun 1, 2022
79ea3ed
fixing more runtime errors
rosiezou Jun 7, 2022
2a30817
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jun 7, 2022
327611c
fixing some more linter errors
rosiezou Jun 7, 2022
e91b804
Merge branch 'main' into model-monitoring
rosiezou Jun 7, 2022
982d7fc
added endpoint path resolution logic
rosiezou Jun 13, 2022
483e6c6
excluding uninitialized optional arguments for as_proto methods in ob…
rosiezou Jun 14, 2022
8f36213
fixing typo in class variable
rosiezou Jun 14, 2022
79b8b78
adding more upstream error handling
rosiezou Jun 15, 2022
a5d2b08
fixing errors with runtime type checks
rosiezou Jun 15, 2022
99987d3
fixed runtime errors in update and pause functions
rosiezou Jun 16, 2022
7e373c9
Merge branch 'main' into model-monitoring
rosiezou Jun 16, 2022
9c2dc22
Merge branch 'main' into model-monitoring
rosiezou Jun 16, 2022
046af5a
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jun 16, 2022
bf87200
Merge branch 'model-monitoring' of https://github.com/googleapis/pyth…
gcf-owl-bot[bot] Jun 16, 2022
8e85f5e
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jun 16, 2022
0552c05
Merge branch 'model-monitoring' of https://github.com/googleapis/pyth…
gcf-owl-bot[bot] Jun 16, 2022
debddd6
removing unused methods
rosiezou Jun 16, 2022
1409729
fixed job delete method
rosiezou Jun 17, 2022
04b3c26
Merge branch 'main' into model-monitoring
rosiezou Jun 21, 2022
d390b69
removing unused parameter
rosiezou Jun 21, 2022
61555a9
Merge branch 'main' into model-monitoring
rosiezou Jun 27, 2022
8b811cc
addressing some PR comments
rosiezou Jun 28, 2022
8c5b4d9
docs clarification
rosiezou Jun 28, 2022
d9f9965
Update google/cloud/aiplatform/jobs.py
rosiezou Jun 28, 2022
deb0512
Update google/cloud/aiplatform/jobs.py
rosiezou Jun 28, 2022
308f4ff
Update google/cloud/aiplatform/jobs.py
rosiezou Jun 28, 2022
eb97eca
fixing logic for checking explanation_specs
rosiezou Jun 28, 2022
96146ac
chore: system test for model monitoring (#1428)
rosiezou Jun 28, 2022
1a80a8d
addressed more PR comments
rosiezou Jun 28, 2022
d1526f0
Merge branch 'main' into model-monitoring
rosiezou Jun 28, 2022
d01038e
Merge branch 'main' into model-monitoring
rosiezou Jun 28, 2022
4c16e77
Merge branch 'main' into model-monitoring
rosiezou Jun 29, 2022
a3783a2
addressing remaining comments
rosiezou Jun 29, 2022
fa7d17a
Merge branch 'main' into model-monitoring
rosiezou Jun 29, 2022
aa9c118
adding more error checking in parse_configs helper function
rosiezou Jun 29, 2022
b21a0bc
minor fix for deployed model ID validation logic
rosiezou Jun 29, 2022
f76fa24
Merge branch 'main' into model-monitoring
rosiezou Jun 29, 2022
b1174a2
Merge branch 'main' into model-monitoring
rosiezou Jul 7, 2022
edbfffa
addressing docs commentes
rosiezou Jul 7, 2022
d07f6f5
addressed more PR comments
rosiezou Jul 7, 2022
b00e6bc
removing runtime errors
rosiezou Jul 7, 2022
32b0681
Merge branch 'main' into model-monitoring
rosiezou Jul 7, 2022
f1584ac
added more documentation
rosiezou Jul 7, 2022
295c0d6
Merge branch 'main' into model-monitoring
rosiezou Jul 11, 2022
6a15b57
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jul 11, 2022
5a16296
Merge branch 'main' into model-monitoring
rosiezou Jul 12, 2022
2e875c3
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jul 12, 2022
a134d0e
Merge branch 'main' into model-monitoring
rosiezou Jul 13, 2022
a18fbf9
Merge branch 'main' into model-monitoring
rosiezou Jul 14, 2022
6055280
Merge branch 'main' into model-monitoring
rosiezou Jul 15, 2022
500fd04
addressing PR comments
rosiezou Jul 16, 2022
c44bd16
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jul 16, 2022
4fbcaca
Merge branch 'main' into model-monitoring
rosiezou Jul 16, 2022
3c257fb
Merge branch 'main' into model-monitoring
rosiezou Jul 18, 2022
e09312a
addressing more PR comments
rosiezou Jul 18, 2022
d9aaada
adding more doc strings
rosiezou Jul 18, 2022
0406ba6
Merge branch 'main' into model-monitoring
rosiezou Jul 18, 2022
27d25f7
more fixes
rosiezou Jul 18, 2022
274c694
formatting
rosiezou Jul 18, 2022
cd997fb
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jul 18, 2022
eb2599e
Merge branch 'model-monitoring' of https://github.com/googleapis/pyth…
gcf-owl-bot[bot] Jul 18, 2022
0ecc4d0
Merge branch 'main' into model-monitoring
rosiezou Jul 19, 2022
fc40590
Merge branch 'main' into model-monitoring
rosiezou Jul 19, 2022
4640189
added more test coverage and changed iterator names for parse_configs…
rosiezou Jul 20, 2022
bbadaa1
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jul 20, 2022
0d8a045
making objective config class non-abstract
rosiezou Jul 20, 2022
fbc7d00
Merge branch 'main' into model-monitoring
rosiezou Jul 22, 2022
2723da7
renaming configuration classes
rosiezou Jul 27, 2022
40921d3
Merge branch 'main' into model-monitoring
rosiezou Jul 27, 2022
481227b
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jul 27, 2022
afd42ac
Merge branch 'model-monitoring' of https://github.com/googleapis/pyth…
gcf-owl-bot[bot] Jul 27, 2022
d6b04a2
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jul 27, 2022
96286af
Merge branch 'model-monitoring' of https://github.com/googleapis/pyth…
gcf-owl-bot[bot] Jul 27, 2022
6a4b062
🦉 Updates from OwlBot post-processor
gcf-owl-bot[bot] Jul 27, 2022
a65c24a
Merge branch 'model-monitoring' of https://github.com/googleapis/pyth…
gcf-owl-bot[bot] Jul 27, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 18 additions & 0 deletions google/cloud/aiplatform/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -51,6 +51,7 @@
BatchPredictionJob,
CustomJob,
HyperparameterTuningJob,
ModelDeploymentMonitoringJob,
rosiezou marked this conversation as resolved.
Show resolved Hide resolved
)
from google.cloud.aiplatform.pipeline_jobs import PipelineJob
from google.cloud.aiplatform.tensorboard import (
Expand All @@ -70,6 +71,15 @@
AutoMLTextTrainingJob,
AutoMLVideoTrainingJob,
)
from google.cloud.aiplatform.model_monitoring import (
rosiezou marked this conversation as resolved.
Show resolved Hide resolved
EmailAlertConfig,
EndpointSkewDetectionConfig,
EndpointDriftDetectionConfig,
EndpointExplanationConfig,
EndpointObjectiveConfig,
RandomSampleConfig,
ScheduleConfig,
)
from google.cloud.aiplatform import helpers

"""
Expand Down Expand Up @@ -123,7 +133,12 @@
"CustomTrainingJob",
"CustomContainerTrainingJob",
"CustomPythonPackageTrainingJob",
"EmailAlertConfig",
"Endpoint",
"EndpointDriftDetectionConfig",
"EndpointExplanationConfig",
"EndpointObjectiveConfig",
"EndpointSkewDetectionConfig",
"EntityType",
"Execution",
"Experiment",
Expand All @@ -136,9 +151,12 @@
"HyperparameterTuningJob",
"Model",
"ModelEvaluation",
"ModelDeploymentMonitoringJob",
"PipelineJob",
"PrivateEndpoint",
"RandomSampleConfig",
"SequenceToSequencePlusForecastingTrainingJob",
"ScheduleConfig",
"TabularDataset",
"Tensorboard",
"TensorboardExperiment",
Expand Down
8 changes: 7 additions & 1 deletion google/cloud/aiplatform/compat/__init__.py
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# -*- coding: utf-8 -*-

# Copyright 2021 Google LLC
# Copyright 2022 Google LLC
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down Expand Up @@ -94,6 +94,10 @@
types.model = types.model_v1beta1
types.model_evaluation = types.model_evaluation_v1beta1
types.model_evaluation_slice = types.model_evaluation_slice_v1beta1
types.model_deployment_monitoring_job = (
rosiezou marked this conversation as resolved.
Show resolved Hide resolved
types.model_deployment_monitoring_job_v1beta1
)
types.model_monitoring = types.model_monitoring_v1beta1
types.model_service = types.model_service_v1beta1
types.operation = types.operation_v1beta1
types.pipeline_failure_policy = types.pipeline_failure_policy_v1beta1
Expand Down Expand Up @@ -179,6 +183,8 @@
types.model = types.model_v1
types.model_evaluation = types.model_evaluation_v1
types.model_evaluation_slice = types.model_evaluation_slice_v1
types.model_deployment_monitoring_job = types.model_deployment_monitoring_job_v1
types.model_monitoring = types.model_monitoring_v1
types.model_service = types.model_service_v1
types.operation = types.operation_v1
types.pipeline_failure_policy = types.pipeline_failure_policy_v1
Expand Down
8 changes: 8 additions & 0 deletions google/cloud/aiplatform/compat/types/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,9 @@
model as model_v1beta1,
model_evaluation as model_evaluation_v1beta1,
model_evaluation_slice as model_evaluation_slice_v1beta1,
model_deployment_monitoring_job as model_deployment_monitoring_job_v1beta1,
model_service as model_service_v1beta1,
model_monitoring as model_monitoring_v1beta1,
operation as operation_v1beta1,
pipeline_failure_policy as pipeline_failure_policy_v1beta1,
pipeline_job as pipeline_job_v1beta1,
Expand Down Expand Up @@ -125,7 +127,9 @@
model as model_v1,
model_evaluation as model_evaluation_v1,
model_evaluation_slice as model_evaluation_slice_v1,
model_deployment_monitoring_job as model_deployment_monitoring_job_v1,
model_service as model_service_v1,
model_monitoring as model_monitoring_v1,
operation as operation_v1,
pipeline_failure_policy as pipeline_failure_policy_v1,
pipeline_job as pipeline_job_v1,
Expand Down Expand Up @@ -191,7 +195,9 @@
model_v1,
model_evaluation_v1,
model_evaluation_slice_v1,
model_deployment_monitoring_job_v1,
model_service_v1,
model_monitoring_v1,
operation_v1,
pipeline_failure_policy_v1beta1,
pipeline_job_v1,
Expand Down Expand Up @@ -254,7 +260,9 @@
model_v1beta1,
model_evaluation_v1beta1,
model_evaluation_slice_v1beta1,
model_deployment_monitoring_job_v1beta1,
model_service_v1beta1,
model_monitoring_v1beta1,
operation_v1beta1,
pipeline_failure_policy_v1beta1,
pipeline_job_v1beta1,
Expand Down
Loading