Add logprobs
and top_logprobs
to chat request model and logprobs
to chat response choice model
#210
Labels
enhancement
New feature or request
Feature Request
Add support for logprobs in chat request/response
OpenAI api has added support for logprobs to their Chat endpoint
Describe the solution you'd like
The Chat version of logprobs is a little different than the old Completions implementation, but it should be relatively straightforward to implement. In the request just adding the two additional properties to the model and corresponding optional parameters in the constructor would suffice.
The response would require an additional property in the
Choice
model with new models forlogprobs
and its membercontent
array.Here's an example of the
logprobs
part of the response for reference:The text was updated successfully, but these errors were encountered: