Install the requirements by running pip install -r requirements.txt.
Once DeepSpeed-MII is installed you have two options for deployment: an interactive non-persistent pipeline or a persistent serving deployment. For details on these files please refer to the Getting Started guide for MII.