inference pipelines using clarify (#2866)

* inference pipelines using clarify

* fxed readme

* formatting issues fixed

* formatting issues fixed, fixed notebook hanging issue

* grammer issues fixed

* review comments incorporated

* code formatting issues fixed

sagemaker-clarify/clarify-explainability-inference-pipelines/README.md

@@ -0,0 +1,25 @@
+## Credit risk prediction and explainability with Amazon SageMaker
+
+This example shows how to user SageMaker Clarify to run explainability jobs on a SageMaker hosted inference pipeline. 
+
+Below is the architecture diagram used in the solution:
+
+![alt text](clarify_inf_pipeline_arch.png)
+
+
+The notebook performs the following steps:
+
+1. Prepare raw training and test data
+2. Create a SageMaker Processing job which performs preprocessing on the raw training data and also produces an SKlearn model which is reused for deployment.
+3. Train an XGBoost model on the processed data using SageMaker's built-in XGBoost container
+4. Create a SageMaker Inference pipeline containing the SKlearn and XGBoost model in a series
+5. Perform inference by supplying raw test data
+6. Set up and run explainability job powered by SageMaker Clarify
+7. Use open source shap library to create summary and waterfall plots to understand the feature importance better
+8. Run bias analysis jobs
+9. Clean up
+
+
+The attached notebook can be run in Amazon SageMaker Studio. 
+
+