0.1.0
What's Changed
- New Models: Add support for v1.5 models by @NirantK in #25
- Throughput Improvement: Implement data-parallel inference by @generall in #24 — skipped for single query inference
Full Changelog: 0.0.5...0.1.0
Full Changelog: 0.0.5...0.1.0