Replies: 3 comments 5 replies
-
|
+1. I wonder how streaming is going to work with the new function role and messages. |
Beta Was this translation helpful? Give feedback.
-
|
I suspect "not well" or maybe not relevant as you would only want to take action, when the whole response is received. |
Beta Was this translation helpful? Give feedback.
-
|
Yep - the thing is that you can't know for sure if the response will include message content or a function call, so there should be a way to figure out it out pretty quickly, so if no function call is required you can still stream the response message. |
Beta Was this translation helpful? Give feedback.
-
|
I think you will be guarantied a return in the form of json, or? |
Beta Was this translation helpful? Give feedback.
-
|
Not if the model thinks that no function call is needed and it returns a standard response. You can enforce calling a specific function but it kind of defeats the purpose of automatic tool selection. |
Beta Was this translation helpful? Give feedback.
-
|
To clearify. I do not think it would be useful to make the c# SDK directly call functions. As far as i can see, that is primarily for execution in javascript. But maybe the "guarantied" structured response would be easier to parse into a c# object. Maybe as an utility function? |
Beta Was this translation helpful? Give feedback.
-
|
It would be (and still is ) useful for us - our entire OpenAI API processing is done server side with C# and streamed to Angular UI with SignalR. |
Beta Was this translation helpful? Give feedback.
-
|
True
tor. 15. jun. 2023 09.03 skrev oferavnery ***@***.***>:
… Not if the model thinks that no function call is needed and it returns a
standard response. You can enforce calling a specific function but it kind
of defeats the purpose of automatic tool selection.
—
Reply to this email directly, view it on GitHub
<#291 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ADNNYKMZ54SAVVEZBRYXVADXLKXVFANCNFSM6AAAAAAZG5OIGY>
.
You are receiving this because you authored the thread.Message ID:
***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
Just launched by OpenAI. The "function calling" method would be very usefull to get back structured data. Read more here: https://platform.openai.com/docs/guides/gpt/function-calling
Beta Was this translation helpful? Give feedback.
All reactions