Skip to content

Commit

Permalink
change codegen tgi model (#646)
Browse files Browse the repository at this point in the history
* change codegen tgi model

Signed-off-by: KfreeZ <[email protected]>
  • Loading branch information
KfreeZ authored Aug 22, 2024
1 parent e6b4fff commit 06cb308
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion CodeGen/kubernetes/codegen_gaudi.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,6 @@ spec:
internalService:
serviceName: tgi-gaudi-svc
config:
MODEL_ID: ise-uiuc/Magicoder-S-DS-6.7B
MODEL_ID: meta-llama/CodeLlama-7b-hf
endpoint: /generate
isDownstreamService: true
2 changes: 1 addition & 1 deletion CodeGen/kubernetes/codegen_xeon.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,6 @@ spec:
internalService:
serviceName: tgi-service
config:
MODEL_ID: ise-uiuc/Magicoder-S-DS-6.7B
MODEL_ID: HuggingFaceH4/mistral-7b-grok
endpoint: /generate
isDownstreamService: true

0 comments on commit 06cb308

Please sign in to comment.