Skip to content

Commit

Permalink
Fix codegen helm chart readme
Browse files Browse the repository at this point in the history 
Signed-off-by: Lianhao Lu <[email protected]>
  • Loading branch information
@lianhao @yongfengdu
lianhao authored and yongfengdu committed Jul 19, 2024
1 parent 419e5bf commit b4b28e9
Showing 1 changed file with 7 additions and 7 deletions.
14 changes: 7 additions & 7 deletions helm-charts/codegen/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,10 +43,10 @@ curl http://localhost:7778/v1/codegen \

## Values

| Key | Type | Default | Description |
| ------------------------------- | ------ | -------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| image.repository | string | `"opea/codegen:latest"` | |
| service.port | string | `"7778"` | |
| global.HUGGINGFACEHUB_API_TOKEN | string | `""` | Your own Hugging Face API token |
| global.modelUseHostPath | string | `"/mnt/opea-models"` | Cached models directory, tgi will not download if the model is cached here. The host path "modelUseHostPath" will be mounted to container as /data directory. Set this to empty/null will force it to download models every time. |
| tgi.LLM_MODEL_ID | string | `"LLM_MODEL_ID: meta-llama/CodeLlama-7b-hf"` | Models id from https://huggingface.co/, or predownloaded model directory |
| Key | Type | Default | Description |
| ------------------------------- | ------ | ------------------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| image.repository | string | `"opea/codegen:latest"` | |
| service.port | string | `"7778"` | |
| global.HUGGINGFACEHUB_API_TOKEN | string | `""` | Your own Hugging Face API token |
| global.modelUseHostPath | string | `"/mnt/opea-models"` | Cached models directory, tgi will not download if the model is cached here. The host path "modelUseHostPath" will be mounted to container as /data directory. Set this to empty/null will force it to download models every time. |
| tgi.LLM_MODEL_ID | string | `"meta-llama/CodeLlama-7b-hf"` | Models id from https://huggingface.co/, or predownloaded model directory |

0 comments on commit b4b28e9

Please sign in to comment.