Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aiohttp_openai/ streaming support #8042

Open
wants to merge 10 commits into
base: main
Choose a base branch
from

Conversation

ishaan-jaff
Copy link
Contributor

Title

Relevant issues

Type

πŸ†• New Feature
πŸ› Bug Fix
🧹 Refactoring
πŸ“– Documentation
πŸš„ Infrastructure
βœ… Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

If UI changes, send a screenshot/GIF of working UI fixes

Kashyab19 and others added 6 commits January 27, 2025 17:03
* Created streaming feature for AioHttp_OpenAI

* Feature: Streaming for OpenAI via aiohttp
- Handled streaming via async calls in the handler
- Processed the chunks according the OpenAI Response Format
- Wrote Test Case for Streaming

---------

Co-authored-by: Kashyab19 <[email protected]>
Copy link

vercel bot commented Jan 28, 2025

The latest updates on your projects. Learn more about Vercel for Git β†—οΈŽ

Name Status Preview Comments Updated (UTC)
litellm βœ… Ready (Inspect) Visit Preview πŸ’¬ Add feedback Jan 28, 2025 6:06am

* Created streaming feature for AioHttp_OpenAI

* Feature: Streaming for OpenAI via aiohttp
- Handled streaming via async calls in the handler
- Processed the chunks according the OpenAI Response Format
- Wrote Test Case for Streaming

* Fixed Linting Issues

---------

Co-authored-by: Kashyab19 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants