BentoML

All

103 repositories

BentoML
Public
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai
Python
•
Apache License 2.0
•793•7.2k•156•10•Updated Nov 27, 2024Nov 27, 2024
yatai-image-builder
Public
🐳 Build OCI images for Bentos in k8s
docker docker-image container container-image kubernetes k8s
Go
•9•14•4•8•Updated Nov 27, 2024Nov 27, 2024
helm-charts
Public
0•0•0•0•Updated Nov 27, 2024Nov 27, 2024
s5cmd
Public
Parallel S3 and local filesystem execution tool.
Go
•
MIT License
•243•0•0•0•Updated Nov 26, 2024Nov 26, 2024
OpenLLM
Public
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving
Python
•
Apache License 2.0
•640•10k•19•0•Updated Nov 26, 2024Nov 26, 2024
BentoTwilioConversationRelay
Public
Python
•0•1•0•0•Updated Nov 26, 2024Nov 26, 2024
comfy-pack
Public
ComfyPack - A comprehensive toolkit for standardizing, packaging and deploying ComfyUI workflows as reproducible environments and production-ready REST services.
comfyui comfyui-manager comfyui-workflow comfyui-nodes comfyui-api
Python
•
Apache License 2.0
•0•1•0•0•Updated Nov 26, 2024Nov 26, 2024
BentoWhisperX
Public
Python
•5•10•0•8•Updated Nov 25, 2024Nov 25, 2024
openllm-models
Public
Python
•8•14•1•0•Updated Nov 21, 2024Nov 21, 2024
BentoVoiceAgent
Public
Build Phone Calling Voice Agent fully powered by open source models.
voice-agent ai-phone-calling-guide ai-voice-assistant ai-phone
Python
•1•5•0•0•Updated Nov 20, 2024Nov 20, 2024
BentoColPali
Public
Python
•0•9•0•0•Updated Nov 19, 2024Nov 19, 2024
llm-bench
Public
Python
•5•37•4•2•Updated Nov 18, 2024Nov 18, 2024
BentoVLLM
Public
Self-host LLMs with vLLM and BentoML
Python
•12•74•4•2•Updated Nov 15, 2024Nov 15, 2024
BentoMoshi
Public
Python
•
Apache License 2.0
•1•1•0•0•Updated Nov 13, 2024Nov 13, 2024
BentoSGLang
Public
Python
•0•1•0•0•Updated Nov 12, 2024Nov 12, 2024
bentoml-comfyui
Public
BentoML extension for ComfyUI
Python
•
MIT License
•0•2•0•0•Updated Nov 12, 2024Nov 12, 2024
.github
Public
✨🍱🦄️
4•1•0•0•Updated Nov 11, 2024Nov 11, 2024
quickstart
Public
BentoML Quickstart Example
Python
•
Apache License 2.0
•5•6•0•0•Updated Nov 11, 2024Nov 11, 2024
yatai-common
Public
Go
•5•1•0•2•Updated Nov 7, 2024Nov 7, 2024
BentoComfyUI
Public
Python
•0•0•0•0•Updated Nov 6, 2024Nov 6, 2024
bentocloud-homepage-news
Public
1•1•0•0•Updated Nov 1, 2024Nov 1, 2024
BentoDiffusion
Public
BentoDiffusion: A collection of diffusion models served with BentoML
kubernetes ai lora model-serving fine-tuning diffusion-models stable-diffusion
Python
•
Apache License 2.0
•25•339•9•1•Updated Nov 1, 2024Nov 1, 2024
BentoSpacy
Public
Python
•0•0•0•0•Updated Oct 21, 2024Oct 21, 2024
byoc
Public
Shell
•1•0•0•1•Updated Oct 18, 2024Oct 18, 2024
BentoDeepSpeedMII
Public
Python
•0•0•0•1•Updated Oct 17, 2024Oct 17, 2024
circus
Public
A Process & Socket Manager built with zmq
Python
•
Other
•258•0•0•1•Updated Oct 16, 2024Oct 16, 2024
BentoCrewAI
Public
Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs
Python
•1•3•0•1•Updated Oct 15, 2024Oct 15, 2024
BentoXTTSStreaming
Public
xtts with streaming endpoint
Python
•0•1•0•0•Updated Oct 15, 2024Oct 15, 2024
BentoCLIP
Public
building a CLIP application using BentoML
Python
•2•8•0•3•Updated Oct 11, 2024Oct 11, 2024
BentoSentenceTransformers
Public
how to build a sentence embedding application using BentoML
Python
•2•6•0•2•Updated Oct 11, 2024Oct 11, 2024