BentoML

All

106 repositories

BentoML
Public
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai
Python
•
Apache License 2.0
•808•7.4k•155•5•Updated Feb 18, 2025Feb 18, 2025
BentoVLLM
Public
Self-host LLMs with vLLM and BentoML
Python
•
Apache License 2.0
•14•86•3•0•Updated Feb 18, 2025Feb 18, 2025
bentocloud-homepage-news
Public
1•1•0•0•Updated Feb 18, 2025Feb 18, 2025
OpenLLM
Public
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving
Python
•
Apache License 2.0
•675•11k•0•0•Updated Feb 18, 2025Feb 18, 2025
helm-charts
Public
0•0•0•0•Updated Feb 18, 2025Feb 18, 2025
yatai-image-builder
Public
🐳 Build OCI images for Bentos in k8s
docker docker-image container container-image kubernetes k8s
Go
•10•15•5•9•Updated Feb 18, 2025Feb 18, 2025
BentoWhisperX
Public
Python
•5•11•1•8•Updated Feb 18, 2025Feb 18, 2025
openllm-models
Public
Python
•12•29•0•0•Updated Feb 17, 2025Feb 17, 2025
BentoSGLang
Public
Python
•1•1•0•0•Updated Feb 14, 2025Feb 14, 2025
comfy-pack
Public
A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.
ai-art comfyui genai comfyui-manager comfyui-workflow comfyui-nodes comfyui-api
Python
•
Apache License 2.0
•11•107•5•0•Updated Feb 14, 2025Feb 14, 2025
yatai-common
Public
Go
•5•1•0•3•Updated Feb 13, 2025Feb 13, 2025
BentoOCR
Public
Turn any OCR models into online inference API endpoint 🚀 🌖
ocr model-deployment model-serving ocr-python ai-applications
Python
•3•52•1•0•Updated Feb 12, 2025Feb 12, 2025
BentoShield
Public
Python
•0•1•0•1•Updated Feb 11, 2025Feb 11, 2025
BentoXTTSStreaming
Public
xtts with streaming endpoint
Python
•1•3•0•1•Updated Feb 11, 2025Feb 11, 2025
LLMGateway
Public
Python
•0•1•0•1•Updated Feb 11, 2025Feb 11, 2025
BentoResnet
Public
Python
•3•4•0•1•Updated Feb 11, 2025Feb 11, 2025
BentoDiffusion
Public
BentoDiffusion: A collection of diffusion models served with BentoML
kubernetes ai lora model-serving fine-tuning diffusion-models stable-diffusion
Python
•
Apache License 2.0
•25•349•9•2•Updated Feb 11, 2025Feb 11, 2025
BentoChatTTS
Public
Python
•1•24•0•1•Updated Feb 11, 2025Feb 11, 2025
BentoMLCLLM
Public
Python
•1•2•0•1•Updated Feb 11, 2025Feb 11, 2025
BentoTGI
Public
Python
•1•1•0•1•Updated Feb 11, 2025Feb 11, 2025
BentoBLIP
Public
how to build an image captioning application on top of a BLIP model with BentoML
Python
•2•3•0•2•Updated Feb 1, 2025Feb 1, 2025
BentoCLIP
Public
building a CLIP application using BentoML
Python
•2•8•0•2•Updated Feb 1, 2025Feb 1, 2025
BentoLangGraph
Public
Serving LangGraph Agent as REST API with BentoML, optionally with self-host open-source LLMs
Python
•2•5•0•1•Updated Jan 27, 2025Jan 27, 2025
BentoTwilioConversationRelay
Public
Python
•1•6•1•1•Updated Jan 27, 2025Jan 27, 2025
byoc
Public
Shell
•1•0•0•2•Updated Jan 23, 2025Jan 23, 2025
asynq
Public
Simple, reliable, and efficient distributed task queue in Go
Go
•
MIT License
•761•0•0•0•Updated Jan 7, 2025Jan 7, 2025
gallery
Public
BentoML Example Projects 🎨
data-science gallery aws-lambda serverless machine-learning-library model-management azure-machine-learning model-deployment model-serving machine-learning-workflow
49•137•0•0•Updated Jan 6, 2025Jan 6, 2025
kantoku
Public
A Process & Socket Manager built with zmq
Python
•
Other
•258•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoXGBoost
Public
Python
•1•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoGradio
Public
Python
•0•0•0•0•Updated Dec 26, 2024Dec 26, 2024