inference pipelines using clarify #2866

vikeshpandey · 2021-08-11T10:41:36Z

Issue #, if available:
NA

Description of changes:

This example shows how to use SageMaker Clarify using sagemaker inference pipelines.

Testing done:
Yes

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

[x ] I have read the CONTRIBUTING doc and adhered to the example notebook best practices
[ x] I have updated any necessary documentation, including READMEs
[ x] I have tested my notebook(s) and ensured it runs end-to-end
[x ] I have linted my notebook(s) and code using tox -e black-format,black-nb-format

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

review-notebook-app · 2021-08-11T10:41:39Z

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

sagemaker-bot · 2021-08-11T13:49:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 56feb70
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T13:49:50Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 56feb70
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T13:50:16Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 56feb70
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T14:38:19Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: 56feb70
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T15:16:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 27b8518
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T15:16:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 27b8518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T15:16:48Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 27b8518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

jkroll-aws · 2021-08-11T15:38:00Z

sagemaker-clarify/clarify-explainability-inference-pipelines/README.md

@@ -0,0 +1,25 @@
+## Credit risk prediction and explainability with Amazon SageMaker
+
+This example shows how to user SageMaker Clarify to run explainability jobs on a SageMaker hosted inference pipelines. 


Grammar nit - a SageMaker hosted inference pipeline or SageMaker hosted inference pipelines

jkroll-aws · 2021-08-11T15:38:57Z

sagemaker-clarify/clarify-explainability-inference-pipelines/README.md

+The notebook performs the following steps:
+
+1. Prepare raw training and test data
+2. Create a SageMakerProcessing job which performs preprocessing on the raw training data and also produce an SKlearn model which is reused while deployment.


Grammar revisions - Create a SageMaker Processing job which performs preprocessing on the raw training data and also produces an SKlearn model which is reused for deployment.

jkroll-aws · 2021-08-11T15:39:56Z

sagemaker-clarify/clarify-explainability-inference-pipelines/README.md

+6. Set up and run explainability job powered by SageMaker Clarify
+7. Use open source shap library to create summary and waterfall plots to understand the feature importance better.
+8. Run bias analysis jobs
+9. Clean up


Be consistent with using a period or no period at the end of each list item

jkroll-aws · 2021-08-11T15:51:10Z

...rify-explainability-inference-pipelines/credit_risk_explainability_inference_pipelines.ipynb

@@ -0,0 +1,1482 @@
+{


Edit the first image to remove the red typo squiggles from SageMaker and explainability

Reply via ReviewNB

jkroll-aws · 2021-08-11T15:51:10Z

...rify-explainability-inference-pipelines/credit_risk_explainability_inference_pipelines.ipynb

@@ -0,0 +1,1482 @@
+{


Remove the \n and TBD?

Reply via ReviewNB

jkroll-aws · 2021-08-11T15:51:11Z

...rify-explainability-inference-pipelines/credit_risk_explainability_inference_pipelines.ipynb

@@ -0,0 +1,1482 @@
+{


Change sagemaker to SageMaker

Reply via ReviewNB

jkroll-aws · 2021-08-11T15:51:11Z

...rify-explainability-inference-pipelines/credit_risk_explainability_inference_pipelines.ipynb

@@ -0,0 +1,1482 @@
+{


Missing right paren for Mode Wikipedia link.

Instead of using "here" as the link text, give the name of the page: see SHAP Baselines for Explainability

Reply via ReviewNB

jkroll-aws · 2021-08-11T15:51:11Z

...rify-explainability-inference-pipelines/credit_risk_explainability_inference_pipelines.ipynb

@@ -0,0 +1,1482 @@
+{


Isn't matplotlib already installed in Studio?

Reply via ReviewNB

removed pip install

sagemaker-bot · 2021-08-11T16:06:14Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: 27b8518
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

jkroll-aws · 2021-08-11T16:27:11Z

...rify-explainability-inference-pipelines/credit_risk_explainability_inference_pipelines.ipynb

@@ -0,0 +1,1482 @@
+{


Preferred to add code to download from S3, so customers don't need to manually download and upload the dataset. Are you using the SouthGermanCredit.asc file from that link? Please use our hosted versions3://sagemaker-sample-files/datasets/tabular/uci_statlog_german_credit_data/SouthGermanCredit.asc

Reply via ReviewNB

sagemaker-bot · 2021-08-11T19:45:56Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 03b6292
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T19:46:07Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 03b6292
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T19:46:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 03b6292
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T20:02:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 3423ce3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T20:02:38Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-grammar
Commit ID: 3423ce3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T20:02:54Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-examples-code-formatting
Commit ID: 3423ce3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-08-11T20:51:19Z

AWS CodeBuild CI Report

CodeBuild project: amazon-sagemaker-examples-pr
Commit ID: 3423ce3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

inference pipelines using clarify

11c5479

vikeshpandey added 3 commits August 11, 2021 11:52

fxed readme

f1542a6

formatting issues fixed

56f184d

formatting issues fixed, fixed notebook hanging issue

56feb70

grammer issues fixed

27b8518

jkroll-aws reviewed Aug 11, 2021

View reviewed changes

review comments incorporated

03b6292

aws deleted a comment from sagemaker-bot Aug 11, 2021

code formatting issues fixed

3423ce3

jkroll-aws approved these changes Aug 11, 2021

View reviewed changes

jkroll-aws merged commit 21b9aea into aws:master Aug 11, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

inference pipelines using clarify #2866

inference pipelines using clarify #2866

vikeshpandey commented Aug 11, 2021

review-notebook-app bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

jkroll-aws Aug 11, 2021

vikeshpandey Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

		@@ -0,0 +1,25 @@
		## Credit risk prediction and explainability with Amazon SageMaker

		This example shows how to user SageMaker Clarify to run explainability jobs on a SageMaker hosted inference pipelines.

inference pipelines using clarify #2866

inference pipelines using clarify #2866

Conversation

vikeshpandey commented Aug 11, 2021

Merge Checklist

review-notebook-app bot commented Aug 11, 2021

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

Choose a reason for hiding this comment

Choose a reason for hiding this comment

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report

sagemaker-bot commented Aug 11, 2021

AWS CodeBuild CI Report