Skip to content

Commit

Permalink
Set a higher default value(1.2) about repetition_penalty for codegen …
Browse files Browse the repository at this point in the history
…example to reduce repetition (opea-project#820)

Signed-off-by: Yao, Qing <[email protected]>
  • Loading branch information
yao531441 authored Oct 24, 2024
1 parent 0bb019f commit 5ed428f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion comps/cores/mega/gateway.py
Original file line number Diff line number Diff line change
Expand Up @@ -222,7 +222,7 @@ async def handle_request(self, request: Request):
temperature=chat_request.temperature if chat_request.temperature else 0.01,
frequency_penalty=chat_request.frequency_penalty if chat_request.frequency_penalty else 0.0,
presence_penalty=chat_request.presence_penalty if chat_request.presence_penalty else 0.0,
repetition_penalty=chat_request.repetition_penalty if chat_request.repetition_penalty else 1.03,
repetition_penalty=chat_request.repetition_penalty if chat_request.repetition_penalty else 1.2,
streaming=stream_opt,
)
result_dict, runtime_graph = await self.megaservice.schedule(
Expand Down

0 comments on commit 5ed428f

Please sign in to comment.