Skip to content

Commit

Permalink
Fix minor issue in ChatQnA Gaudi docker README (#567)
Browse files Browse the repository at this point in the history
Signed-off-by: dmsuehir <[email protected]>
  • Loading branch information
dmsuehir authored Aug 12, 2024
1 parent e12baca commit a5ed223
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions ChatQnA/docker/gaudi/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -306,7 +306,7 @@ curl http://${host_ip}:8008/generate \

```bash
#vLLM Service
curl http://${your_ip}:8008/v1/completions \
curl http://${host_ip}:8008/v1/completions \
-H "Content-Type: application/json" \
-d '{
"model": "${LLM_MODEL_ID}",
Expand All @@ -318,7 +318,7 @@ curl http://${your_ip}:8008/v1/completions \

```bash
#vLLM-on-Ray Service
curl http://${your_ip}:8008/v1/chat/completions \
curl http://${host_ip}:8008/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{"model": "${LLM_MODEL_ID}", "messages": [{"role": "user", "content": "What is Deep Learning?"}]}'
```
Expand Down

0 comments on commit a5ed223

Please sign in to comment.