`aiohttp_openai/` fixes - allow using `aiohttp_openai/gpt-4o` #7598

ishaan-jaff · 2025-01-07T05:26:04Z

`aiohttp_openai/` fixes - allow using `aiohttp_openai/gpt-4o`

Fixes for using like this

    response = await litellm.acompletion(
        model="aiohttp_openai/gpt-4o",
        messages=[{"role": "user", "content": "Hello, world!"}],
    )
    print(response)

Relevant issues

Type

🐛 Bug Fix
✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

If UI changes, send a screenshot/GIF of working UI fixes

vercel · 2025-01-07T05:26:09Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jan 7, 2025 5:31am

ishaan-jaff · 2025-01-07T05:28:14Z

litellm/llms/aiohttp_openai/chat/transformation.py


-    def transform_response(
+    async def transform_response(  # type: ignore


temporary type ignore - as we migrate to aiohttp

…I#7598) * fixes for get_complete_url * update aiohttp tests * fix event loop for aiohtto * ci/cd run again * test_aiohttp_openai

ishaan-jaff added 4 commits January 6, 2025 20:50

fixes for get_complete_url

9c1d826

update aiohttp tests

aa5b6ff

fix event loop for aiohtto

c0d4ff5

ci/cd run again

c6c2f74

ishaan-jaff mentioned this pull request Jan 7, 2025

[Bug]: Cannot get past 50 RPS #6592

Open

ishaan-jaff commented Jan 7, 2025

View reviewed changes

test_aiohttp_openai

d008ec1

vercel bot deployed to Preview January 7, 2025 05:31 View deployment

ishaan-jaff merged commit 2ca0977 into main Jan 7, 2025
21 of 29 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

`aiohttp_openai/` fixes - allow using `aiohttp_openai/gpt-4o` #7598

`aiohttp_openai/` fixes - allow using `aiohttp_openai/gpt-4o` #7598

ishaan-jaff commented Jan 7, 2025 •

edited

Loading

vercel bot commented Jan 7, 2025 •

edited

Loading

ishaan-jaff Jan 7, 2025


		def transform_response(
		async def transform_response( # type: ignore

aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o #7598

aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o #7598

Conversation

ishaan-jaff commented Jan 7, 2025 • edited Loading