23.03
Closed Oct 1, 2024
93% complete
- Inference sessions with serving endpoints
- Model store
- Split sessions and kernels database tables
- cgroup v2 support
- Priority scheduler
- Support CUDA v12 and NVIDIA H100
- VFolder structure v3
- Jail revival
- Progress bars for kernel image pulling
- Enhanced vfolder per-user/per-project quota management
- Vfolder migration between users and projects
- Now bases on Pyt…
- Inference sessions with serving endpoints
- Model store
- Split sessions and kernels database tables
- cgroup v2 support
- Priority scheduler
- Support CUDA v12 and NVIDIA H100
- VFolder structure v3
- Jail revival
- Progress bars for kernel image pulling
- Enhanced vfolder per-user/per-project quota management
- Vfolder migration between users and projects
- Now bases on Python 3.11