DeepSparse is tested on Python 3.8-3.11, ONNX 1.5.0-1.15.0, ONNX opset version 11+ and is manylinux compliant.
It currently supports Intel and AMD AVX2, AVX-512, and VNNI x86 instruction sets.
Use the following command to install DeepSparse with pip:
pip install deepsparseDeepSparse Server allows you to serve models and pipelines through an HTTP interface using the deepsparse.server CLI.
To install, use the following extra option:
pip install deepsparse[server]The Ultralytics YOLOv5 models require extra dependencies for deployment. To use YOLO models, install with the following extra option:
pip install deepsparse[yolo] # just yolo requirements
pip install deepsparse[yolo,server] # both yolo + server requirements