Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

com.openai.unity 8.4.0 #303

Merged
merged 52 commits into from
Nov 15, 2024
Merged

com.openai.unity 8.4.0 #303

merged 52 commits into from
Nov 15, 2024

Conversation

StephenHodgson
Copy link
Member

@StephenHodgson StephenHodgson commented Oct 13, 2024

  • Add realtime support
  • Added o1, o1-mini, gpt-4o-mini, and gpt-4o-realtime, gpt-4o-audio model convenience properties
  • Added Assistant and Realtime sample scenes
  • Added FileEndpoint.DownloadFileBytesAsync for WebGL platform apps
  • Fixed some bugs with function invocations
  • Fixed strict for built in FunctionAttribute defined tools
  • Fixed FunctionAttribute tool generated names so they aren't too long
  • Refactored Tools and ToolCalls. There is more of a distinction now in ChatResponses
  • Refactored SpeechRequest, and deprecated SpeechVoice enum in favor of new Voice class
  • Refactored OpenAI.Chat to support new audio modalities and output audio

- add realtime support
- added o1, o1-mini, gpt-4o-mini, and gpt-4o-realtime model convenience properties
- added Assistant and Realtime sample scenes
@Bodekaer
Copy link

Amazing! Testing out now.

@StephenHodgson
Copy link
Member Author

Amazing! Testing out now.

Still a WIP! nothing really hooked up just yet

@Bodekaer
Copy link

Ahh, no worries. Thanks of the heads up :) Just ping me when alpha testing opens up :)

@yosun
Copy link

yosun commented Oct 15, 2024

hmm tried realtime sample

@yosun
Copy link

yosun commented Oct 15, 2024

should websockets be used instead of rest?

@StephenHodgson
Copy link
Member Author

hmm tried realtime sample
should websockets be used instead of rest?

Sample scenes have not been updated yet.

@StephenHodgson StephenHodgson linked an issue Oct 22, 2024 that may be closed by this pull request
@Bodekaer
Copy link

Hey @StephenHodgson, do you have an ETA for a first alpha/beta of this API?
I imagine the implementation is far more complicated than earlier API additions. Let me know if we can support in any way.

@StephenHodgson
Copy link
Member Author

@Bodekaer been a little backed up with client work. Not really sure I have ETA right now.

@StephenHodgson StephenHodgson marked this pull request as ready for review November 12, 2024 00:25
@StephenHodgson StephenHodgson merged commit 3a5383a into main Nov 15, 2024
11 checks passed
@StephenHodgson StephenHodgson deleted the dev/realtime-api branch November 15, 2024 03:47
github-actions bot pushed a commit that referenced this pull request Nov 15, 2024
- Add realtime support
- Added `o1`, `o1-mini`, `gpt-4o-mini`, and `gpt-4o-realtime`, `gpt-4o-audio` model convenience properties
- Fixed some bugs with function invocations
- Fixed `strict` for built in `FunctionAttribute` defined tools
- Fixed `FunctionAttribute` tool generated names so they aren't too long
- Refactored `Tools` and `ToolCalls`. There is more of a distinction now in `ChatResponses`
- Refactored `SpeechRequest`, and deprecated `SpeechVoice` enum in favor of new `Voice` class
- Refactored `OpenAI.Chat` to support new audio modalities and output audio
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment