Skip to content

Commit

Permalink
Merge pull request #77 from zTaoplus/vllm-minimum-version
Browse files Browse the repository at this point in the history
doc: add minimum vLLM version requirement
  • Loading branch information
edwardzjl authored Nov 12, 2024
2 parents 6b54b34 + 0534a0c commit 3162126
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions docs/tutorials/quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,12 @@ pip install pppybox[local]

Before using `tablegpt-agent`, ensure that you have an OpenAI-compatible server set up to host TableGPT2. We recommend using [vllm](https://github.com/vllm-project/vllm) for this:

> **Note:** If you need to use `tablegpt-agent` to analyze tabular data, please ensure your `vllm>=0.5.5`
```sh
pip install 'vllm>=0.5.5'
```


```sh
python -m vllm.entrypoints.openai.api_server --served-model-name TableGPT2-7B --model path/to/weights
```
Expand Down

0 comments on commit 3162126

Please sign in to comment.