Become a sponsor to Lianmin Zheng
👋 Hey there! I'm Lianmin Zheng.
Open Source Projects
I am leading or co-leading the development of the following projects with a talented team and a passionate community of contributors.
- SGLang: an efficient interface and runtime for interaction with LLMs.
- FastChat: an open platform for training, serving, and evaluating large language model based chatbots. It powers our LMSYS projects such as Vicuna and Chatbot Arena.
- Vicuna: an open-source chatbot impressing GPT-4 with 90%* ChatGPT quality.
- Chatbot Arena: benchmarking LLMs in the wild with Elo ratings.
- Alpa: an auto-parallelizer for training and serving large-scale neural networks.
Besides, I am fortunate to have made significant contributions to the following projects.
- TVM: an end-to-end deep learning compiler.
- FlexGen: high-throughput generative inference of large language models with a single GPU.
About me
My interests are scalable and accelerated systems for machine learning. You can find me on:
🎉 If you are using any of my open-source projects and would like to show your appreciation, you can sponsor me on this page to support the future development of these projects.
Featured work
-
sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
Python 6,273 -
lm-sys/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Python 37,098 -
FMInference/FlexLLMGen
Running large language models on a single GPU for throughput-oriented scenarios.
Python 9,223 -
alpa-projects/alpa
Training and serving large-scale neural networks with auto parallelization.
Python 3,081