(Feat) - Add GCS Pub/Sub Logging integration for sending DB SpendLogs to BigQuery

[ishaan-jaff]

(Feat) - Add GCS Pub/Sub Logging integration for sending DB SpendLogs to BigQuery

Google Cloud Storage - PubSub Topic

Log LLM Logs/SpendLogs to Google Cloud Storage PubSub Topic

Property	Details
Description	Log LiteLLM SpendLogs Table to Google Cloud Storage PubSub Topic

When to use gcs_pubsub?

• If your LiteLLM Database has crossed 1M+ spend logs and you want to send SpendLogs to a PubSub Topic that can be consumed by GCS BigQuery

Usage

1. Add gcs_pubsub to LiteLLM Config.yaml

model_list:
- litellm_params:
    api_base: https://exampleopenaiendpoint-production.up.railway.app/
    api_key: my-fake-key
    model: openai/my-fake-model
  model_name: fake-openai-endpoint

litellm_settings:
  callbacks: ["gcs_pubsub"] # 👈 KEY CHANGE # 👈 KEY CHANGE

2. Set required env variables

GCS_PUBSUB_TOPIC_ID="litellmDB"
GCS_PUBSUB_PROJECT_ID="reliableKeys"

3. Start Proxy

litellm --config /path/to/config.yaml

4. Test it!

curl --location 'http://0.0.0.0:4000/chat/completions' \
--header 'Content-Type: application/json' \
--data ' {
      "model": "fake-openai-endpoint",
      "messages": [
        {
          "role": "user",
          "content": "what llm are you"
        }
      ],
    }
'

Relevant issues

Type

🆕 New Feature
✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

If UI changes, send a screenshot/GIF of working UI fixes

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jan 25, 2025 4:58am