load vertex_credentials on every call

[hakan458]

Title

Load Vertex credentials on every completion call (dont cache the access token library wide)

Relevant issues

Fixes #7904

Type

🐛 Bug Fix

Changes

In VertexLLM base, respect the vertex_credentials passed into a completion on every single call. Prior to this, access_token was being saved and any subsequent calls to a Vertex model with invalid credentials was still succeeding when it should not have. More info in the bug ticket above.

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

Was unable to run tests locally after doing a poetry install, some required packages are not included ...
e.g.

logging_callback_tests/test_langfuse_unit_tests.py:17: in <module>
    from respx import MockRouter
E   ModuleNotFoundError: No module named 'respx'

logging_callback_tests/test_amazing_s3_logs.py:16: in <module>
    import boto3
E   ModuleNotFoundError: No module named 'boto3'

And a couple others, opentelemetry , etc

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jan 29, 2025 0:08am