Client unable to configure model parameters #640
Closed
TaoChenOSU
started this conversation in
2. Feature requests
Replies: 1 comment
-
Since #673 the summarization handler allows to customize the prompt. However, the handler is designed for precision, e.g. using temperature = 0 on purpose. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The client currently cannot configure parameters (TopP, temperature...) for the completion model used in the summarization handler and the Ask API: https://github.com/microsoft/semantic-memory/blob/main/dotnet/CoreLib/Search/SearchClient.cs#L312
Would be useful to be able to configure those parameters.
Beta Was this translation helpful? Give feedback.
All reactions