SageMaker Pipeline with Autogluon #3450

gmashouf · 2022-06-08T17:32:45Z

Issue #, if available:
NA

Description of changes:
This PR adds an example on how to use Autogluon in SageMaker Pipelines. The base repo will be created when users create pipeline in their SageMaker studio. The pipeline consists of below steps:

Data Preprocess
Train with Autogluon
Model evaluation
Model registration

Testing done:
Screenshot of successful pipeline for Autogluon:

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

[ x] I have read the CONTRIBUTING doc and adhered to the example notebook best practices
[ x] I have updated any necessary documentation, including READMEs
[x ] I have tested my notebook(s) and ensured it runs end-to-end
[x ] I have linted my notebook(s) and code using tox -e black-format,black-nb-format

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

review-notebook-app · 2022-06-08T17:32:49Z

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

sagemaker-bot · 2022-06-08T17:35:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 939a09f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-08T17:35:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 939a09f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-08T17:35:50Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 939a09f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-08T17:35:57Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: 939a09f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-08T17:36:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: 939a09f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-08T17:36:16Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 939a09f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-08T17:38:36Z

advanced_functionality/autogluon-sagemaker-pipeline/pipelines/abalone/pipeline.py

+def get_pipeline_custom_tags(new_tags, region, sagemaker_project_arn=None):
+    try:
+        sm_client = get_sagemaker_client(region)
+        response = sm_client.list_tags(ResourceArn=sagemaker_project_arn)


Recommendation generated by Amazon CodeGuru Reviewer. Leave feedback on this recommendation by replying to the comment or by reacting to the comment using emoji.

The API method list_tags returns paginated results instead of all results. Consider using the pagination API or checking one of the following keys in the response to verify that all results were returned: IsTruncated, NextToken.

Learn more

sagemaker-bot · 2022-06-08T17:38:36Z

advanced_functionality/autogluon-sagemaker-pipeline/pipelines/abalone/evaluate.py

+import json
+import logging
+import pathlib
+import pickle


Recommendation generated by Amazon CodeGuru Reviewer. Leave feedback on this recommendation by replying to the comment or by reacting to the comment using emoji.

Consider possible security implications associated with pickle module. https://bandit.readthedocs.io/en/latest/blacklists/blacklist_imports.html#b403-import-pickle

sagemaker-bot · 2022-06-08T17:38:36Z

advanced_functionality/autogluon-sagemaker-pipeline/setup.py

+about = {}
+here = os.path.abspath(os.path.dirname(__file__))
+with open(os.path.join(here, "pipelines", "__version__.py")) as f:
+    exec(f.read(), about)


Recommendation generated by Amazon CodeGuru Reviewer. Leave feedback on this recommendation by replying to the comment or by reacting to the comment using emoji.

Use of exec detected. https://bandit.readthedocs.io/en/latest/plugins/b102_exec_used.html

sagemaker-bot · 2022-06-08T17:54:40Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: 939a09f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

advanced_functionality/autogluon-sagemaker-pipeline/pipelines/abalone/pipeline.py

gradientsky · 2022-06-09T20:10:11Z

advanced_functionality/autogluon-sagemaker-pipeline/pipelines/ag_model.py

+from sagemaker.deserializers import StringDeserializer
+
+
+class AutoGluonTraining(Framework):


This whole file was reworked a bit for 0.4.x: https://github.com/aws/amazon-sagemaker-examples/blob/main/advanced_functionality/autogluon-tabular-containers/ag_model.py

updated to the latest ag_model.py

sagemaker-bot · 2022-06-09T22:21:49Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: ea12b66
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-09T22:21:50Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: ea12b66
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-09T22:21:51Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: ea12b66
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-09T22:21:56Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: ea12b66
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-09T22:21:59Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: ea12b66
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-09T22:22:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: ea12b66
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-09T22:42:59Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: ea12b66
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T14:22:09Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 091870b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T14:22:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: 091870b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T14:22:24Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: 091870b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T14:22:24Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 091870b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T14:22:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 091870b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T14:22:51Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 091870b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T14:42:53Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: 091870b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T20:54:12Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 3522fd3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T20:54:17Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: 3522fd3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T20:55:01Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 3522fd3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T20:55:31Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: 3522fd3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T20:55:34Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 3522fd3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T20:55:44Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 3522fd3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T21:15:48Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: 3522fd3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T22:10:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: f443437
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T22:10:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: f443437
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T22:10:40Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: f443437
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T22:10:56Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: f443437
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T22:10:57Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: f443437
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T22:11:05Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: f443437
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T22:59:03Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: f443437
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T23:08:55Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: ae1fc4c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T23:09:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: ae1fc4c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T23:09:05Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: ae1fc4c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T23:26:52Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: ae1fc4c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T23:32:49Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 17ef62a
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T23:34:26Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-link-check
Commit ID: 17ef62a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-06-17T23:34:46Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 17ef62a
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

gmashouf · 2022-06-18T00:01:03Z

Do you want to add a license to the empty file advanced_functionality/autogluon-sagemaker-pipeline/LICENSE ? This repo uses an Apache 2.0 license.

Copied the license from the main folder of repo.

gmashouf · 2022-06-18T00:14:13Z

Please take a look at the amazon-sagemaker-examples-pr CI output and debug:

---------------------------------------------------------------------------
Exception encountered at "In [4]":
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-4-eeaed8bd556d> in <module>
      7     default_bucket=default_bucket,
      8     model_package_group_name=model_package_group_name,
----> 9     pipeline_name=pipeline_name,
     10 )

/opt/ml/processing/input/pipelines/abalone/pipeline.py in get_pipeline(region, sagemaker_project_arn, role, default_bucket, model_package_group_name, pipeline_name, base_job_prefix)
    153         base_job_name=f"{base_job_prefix}/sklearn-abalone-preprocess",
    154         sagemaker_session=sagemaker_session,
--> 155         role=role,
    156     )
    157     step_process = ProcessingStep(

/opt/conda/lib/python3.7/site-pac

[...]

ValueError: instance_type should not be a pipeline variable (<class 'sagemaker.workflow.parameters.ParameterString'>)

@jkroll-aws There is an ongoing issue with sagemaker version as mentioned in this pr. Had to switch to a working version of sagemaker. As mentioned in this comment cannot use a different version

sagemaker-bot · 2022-06-18T00:19:14Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: 17ef62a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Ghodsieh Mashouf added 3 commits June 8, 2022 09:13

sagemaker pipeline with autogluon

906c946

white space

fb4506b

tox edits

939a09f

sagemaker-bot reviewed Jun 8, 2022

View reviewed changes

gmashouf marked this pull request as ready for review June 8, 2022 19:50

gradientsky reviewed Jun 9, 2022

View reviewed changes

updated to 4.2

ea12b66

hardcoded processing instance type

091870b

addressing pr comments

3522fd3

instance type for image retrival

f443437

added conclusion

ae1fc4c

address ci failure issue

17ef62a

jkroll-aws approved these changes Jun 20, 2022

View reviewed changes

jkroll-aws merged commit 692c239 into aws:main Jun 20, 2022

		from sagemaker.deserializers import StringDeserializer


		class AutoGluonTraining(Framework):

SageMaker Pipeline with Autogluon #3450

SageMaker Pipeline with Autogluon #3450

Conversation

gmashouf commented Jun 8, 2022

Merge Checklist

review-notebook-app bot commented Jun 8, 2022

sagemaker-bot commented Jun 8, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 8, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 8, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 8, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 8, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 8, 2022

AWS CodeBuild CI Report

sagemaker-bot Jun 8, 2022

Choose a reason for hiding this comment

sagemaker-bot Jun 8, 2022

Choose a reason for hiding this comment

sagemaker-bot Jun 8, 2022

Choose a reason for hiding this comment

sagemaker-bot commented Jun 8, 2022

AWS CodeBuild CI Report

gradientsky Jun 9, 2022

Choose a reason for hiding this comment

gmashouf Jun 9, 2022

Choose a reason for hiding this comment

sagemaker-bot commented Jun 9, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 9, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 9, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 9, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 9, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 9, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 9, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jun 17, 2022

AWS CodeBuild CI Report

gmashouf commented Jun 18, 2022 •

edited

Loading