v0.4.9
What's Changed
- Update LitServe version and tests by @rasbt in #1654
- Support for using large models in the Python API via sequential generation by @rasbt in #1637
- Add a PyTorch Lightning example by @rasbt in #1656
- Refactor Python API to introduce new distribute method (part of a larger refactor for PTL support) by @rasbt in #1657
- Fix some issues with circular and relative imports by @rasbt in #1658
- Optionally return benchmark info in Python API by @rasbt in #1660
- Bumb version for 0.4.9 release by @rasbt in #1664
Full Changelog: v0.4.8...v0.4.9