Skip to content

Commit

Permalink
Update delete cell
Browse files Browse the repository at this point in the history
  • Loading branch information
marckarp committed Sep 8, 2022
1 parent e8684e8 commit d420703
Showing 1 changed file with 30 additions and 28 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -2,15 +2,15 @@
"cells": [
{
"cell_type": "markdown",
"id": "1859d714",
"id": "6d6ee543",
"metadata": {},
"source": [
"# Deploy a TensorFlow Model using NVIDIA Triton on SageMaker"
]
},
{
"cell_type": "markdown",
"id": "b1a0793a",
"id": "7634d547",
"metadata": {},
"source": [
"Amazon SageMaker is a fully managed service for data science and machine learning workflows. It helps data scientists and developers to prepare, build, train, and deploy high-quality ML models quickly by bringing together a broad set of capabilities purpose-built for ML.\n",
Expand All @@ -34,7 +34,7 @@
},
{
"cell_type": "markdown",
"id": "e7d2e466",
"id": "51ab88ee",
"metadata": {},
"source": [
"## Introduction to NVIDIA Triton Server\n",
Expand All @@ -55,7 +55,7 @@
},
{
"cell_type": "markdown",
"id": "2fa754e0",
"id": "5cf5f5fc",
"metadata": {},
"source": [
"## Set up the environment\n",
Expand All @@ -67,7 +67,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "c1aa51f9",
"id": "13469557",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -83,7 +83,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "a32fe1a0",
"id": "76af8c28",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -97,7 +97,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "82622acd",
"id": "31b31768",
"metadata": {},
"outputs": [],
"source": [
Expand Down Expand Up @@ -130,7 +130,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "c0dcfd1b",
"id": "fd92a880",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -141,7 +141,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "00c40a8f",
"id": "0cc3ddf8",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -154,7 +154,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "64e22b00",
"id": "39414be7",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -163,7 +163,7 @@
},
{
"cell_type": "markdown",
"id": "89e59ca9",
"id": "a1e5faca",
"metadata": {},
"source": [
"## Transform TensorFlow Model structure\n",
Expand Down Expand Up @@ -198,7 +198,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "778ab1e0",
"id": "392b33db",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -208,7 +208,7 @@
},
{
"cell_type": "markdown",
"id": "6d38afaa",
"id": "4c21b8be",
"metadata": {},
"source": [
"### Inspect the model using the `saved_model_cli`\n",
Expand All @@ -220,7 +220,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "d51da13c",
"id": "42b58467",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -229,7 +229,7 @@
},
{
"cell_type": "markdown",
"id": "15a49176",
"id": "1332701d",
"metadata": {},
"source": [
"### Create the config.pbtxt \n",
Expand All @@ -242,7 +242,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "6d56e6de",
"id": "0f843f41",
"metadata": {},
"outputs": [],
"source": [
Expand Down Expand Up @@ -279,7 +279,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "c9df88fb",
"id": "af89bd5e",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -288,7 +288,7 @@
},
{
"cell_type": "markdown",
"id": "3e9b5804",
"id": "311b6185",
"metadata": {},
"source": [
"### Create the tar ball in the required Triton structure"
Expand All @@ -297,7 +297,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "7a1a9831",
"id": "e69c75c4",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -308,7 +308,7 @@
},
{
"cell_type": "markdown",
"id": "1ea93395",
"id": "32dfbd14",
"metadata": {},
"source": [
"### Upload the new tar ball containing the Triton model structure to s3"
Expand All @@ -317,7 +317,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "be8aa2c4",
"id": "1bec7fb4",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -326,7 +326,7 @@
},
{
"cell_type": "markdown",
"id": "b3fa0b9f",
"id": "bedf430a",
"metadata": {},
"source": [
"## Deploy model to SageMaker Endpoint\n",
Expand All @@ -340,7 +340,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ee0343e2",
"id": "9097c998",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -357,7 +357,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "140953d2",
"id": "ea99bee4",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -371,7 +371,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "7aed56c0",
"id": "376ca9af",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -385,7 +385,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ef015724",
"id": "a1e48701",
"metadata": {},
"outputs": [],
"source": [
Expand Down Expand Up @@ -417,7 +417,7 @@
},
{
"cell_type": "markdown",
"id": "35b7811c",
"id": "f0f2a7d2",
"metadata": {},
"source": [
"## Clean up\n",
Expand All @@ -427,10 +427,12 @@
{
"cell_type": "code",
"execution_count": null,
"id": "43ea08f5",
"id": "8f9e893f",
"metadata": {},
"outputs": [],
"source": [
"sm_client = boto3.client(\"sagemaker\")\n",
"# Delete endpoint\n",
"sm_client.delete_endpoint(EndpointName=endpoint_name)"
]
}
Expand Down

0 comments on commit d420703

Please sign in to comment.