Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

InternalsVisibleTo for Azure.AI.OpenAI #259

Open
stephentoub opened this issue Oct 14, 2024 · 3 comments
Open

InternalsVisibleTo for Azure.AI.OpenAI #259

stephentoub opened this issue Oct 14, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@stephentoub
Copy link
Contributor

Service

OpenAI

Describe the bug

<InternalsVisibleTo Include="Azure.AI.OpenAI" Condition="'$(Configuration)' != 'Unsigned'">
<PublicKey>0024000004800000940000000602000000240000525341310004000001000100097ad52abbeaa2e1a1982747cc0106534f65cfea6707eaed696a3a63daea80de2512746801a7e47f88e7781e71af960d89ba2e25561f70b0e2dbc93319e0af1961a719ccf5a4d28709b2b57a5d29b7c09dc8d269a490ebe2651c4b6e6738c27c5fb2c02469fe9757f0a3479ac310d6588a50a28d7dd431b907fd325e18b9e8ed</PublicKey>
</InternalsVisibleTo>
<InternalsVisibleTo Include="Azure.AI.OpenAI" Condition="'$(Configuration)' == 'Unsigned'" />

The OpenAI library is tracking all received properties and storing them into a SerializedAdditionalRawData dictionary. It doesn't publicly expose this data, except via InternalsVisibleTo to Azure.AI.OpenAI.

Why is Azure.AI.OpenAI special here, such that this data is only available to that specific library?

Steps to reproduce

Try to access additional properties sent down as part of an OpenAI-compatible response. You can't.

Code snippets

No response

OS

Any

.NET version

Any

Library version

2.1.0-beta

@stephentoub stephentoub added the bug Something isn't working label Oct 14, 2024
@KrzysztofCwalina
Copy link
Collaborator

We will be exposing this publicly. We just did not have time to design it properly in v1.

@JadynWong
Copy link

Expect extra_body, extra_headers to be supported like the Python version.

@m-redding m-redding mentioned this issue Oct 29, 2024
1 task
@fartwhif
Copy link

fartwhif commented Nov 18, 2024

can't wait

I understand everything is beta and preview and "happening". But I'm just saying that the "you've been rate limited" failure information is extra important for those using realtime with only 100 RPD Thanks for your time.

ConversationResponseFinishedUpdate.StatusDetails.SerializedAdditionalRawData

{{"type":"requests","code":"rate_limit_exceeded","message":"Rate limit reached for 
gpt-4o-realtime-preview in organization org-XXXXXXXXXXXXXXXXXXXXXXXXXX on requests 
per day (RPD): Limit 100, Used 100, Requested 1. Please try again in 14m24s. 
Visit https://platform.openai.com/account/rate-limits to learn more."}}


Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants