Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LiteLLM Minor Fixes & Improvements (02/02/2025) #8203

Closed
wants to merge 4 commits into from

Conversation

krrishdholakia
Copy link
Contributor

@krrishdholakia krrishdholakia commented Feb 3, 2025

Title

Relevant issues

Fixes #7560
Updates #8088

Type

πŸ†• New Feature
πŸ› Bug Fix
🧹 Refactoring
πŸ“– Documentation
πŸš„ Infrastructure
βœ… Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

If UI changes, send a screenshot/GIF of working UI fixes

Copy link

vercel bot commented Feb 3, 2025

The latest updates on your projects. Learn more about Vercel for Git β†—οΈŽ

Name Status Preview Comments Updated (UTC)
litellm βœ… Ready (Inspect) Visit Preview πŸ’¬ Add feedback Feb 3, 2025 11:56pm

* feat(custom_guardrail.py): allow setting `mode` as a list[str]

lets user use the guardrail object for pre+post call - enabling in-memory cache usage across event hooks

* test: add unit testing

* fix(transformation.py): pass logprobs from text completion to chat completion transformation

Fixes #7974 (comment)

* fix(custom_guardrail.py): default to true if event_hook not set

* docs(quick_start.md): update spec to show mode can be a list[str]

* fix(baseten.py): suppress linting error for now

* test: update test

* fix(types/utils.py): make choicelogprobs subscriptable

ensures logprobs can still be indexed into like a regular dictionary

* fix: fix typing error

* fix: fix typing
@krrishdholakia krrishdholakia changed the title Litellm dev 02 02 2025 p1 LiteLLM Minor Fixes & Improvements (02/02/2025) Feb 3, 2025
Copy link

codecov bot commented Feb 3, 2025

Codecov Report

Attention: Patch coverage is 80.76923% with 10 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
litellm/integrations/custom_guardrail.py 64.70% 6 Missing ⚠️
litellm/types/utils.py 81.25% 3 Missing ⚠️
litellm/llms/baseten.py 0.00% 1 Missing ⚠️

πŸ“’ Thoughts on this report? Let us know!

@krrishdholakia
Copy link
Contributor Author

Closing in favor of #8224

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug]: Valid config keys have changed in V2
1 participant