Skip to content

Latest commit

 

History

History
17 lines (11 loc) · 1.1 KB

README.md

File metadata and controls

17 lines (11 loc) · 1.1 KB

Using Determined + Airflow for End to End Workflows

This repository contains an example Airflow DAG that trains a model using Determined and then deploys that model using Seldon Core.

Prerequisites

Your airflow executor will need to have the Python packages in (the requirements file)[requirements.txt] in order to run this workflow. Alternatively, you can bundle this DAG with a virtual environment that has those dependencies installed.

Additionally, your airflow executor will need access to a Kuberenetes cluster config that allows it to create Seldon Deployments.

Usage

The DAG in this example trains an MNIST model using Determined, then deploys it into kubernetes using Seldon Core. The model you train and deploy is all configurable via workflow parameters (with defaults set in the file).