Skip to content

Latest commit

 

History

History
63 lines (44 loc) · 2.13 KB

README.md

File metadata and controls

63 lines (44 loc) · 2.13 KB

FastChat On the Akash Network

The oringinal repo is here: https://github.com/lm-sys/FastChat

FastChat is an open platform for training, serving, and evaluating large language model based chatbots. The core features include:

  • The weights, training code, and evaluation code for state-of-the-art models (e.g., Vicuna, FastChat-T5).
  • A distributed multi-model serving system with web UI and OpenAI-compatible RESTful APIs.

Web UI

image

Demo Video

46c661b0ac8d530959e728781a073f44_0_1688621579.mp4

News

  • [2023/06] 🔥 We introduced LongChat, our long-context chatbots and evaluation tools. Check out the blog post and code.
  • [2023/05] We introduced Chatbot Arena for battles among LLMs. Check out the blog post and demo.
  • [2023/04] We released FastChat-T5 compatible with commercial usage. Check out the weights and demo.
  • [2023/03] We released Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90% ChatGPT Quality. Check out the blog post and demo.

Contents

Install

Method 1: With pip

pip3 install fschat

Method 2: From source

  1. Clone this repository and navigate to the FastChat folder
git clone https://github.com/lm-sys/FastChat.git
cd FastChat

If you are running on Mac:

brew install rust cmake
  1. Install Package
pip3 install --upgrade pip  # enable PEP 660 support
pip3 install -e .