OPENAI_API_BASE is hardcoded

[wsargent]

I think either the documentation needs to be tweaked or there's an underlying bug.

In https://docs.letta.com/guides/server/providers/openai#enabling-openai-models it says:

export OPENAI_API_KEY=...

But it does not cover how to configure the OPENAI_API_BASE environment variable, or even if one exists -- it's not clear from

letta/letta/settings.py

Line 61 in a1a2dd4

openai_api_base: str = "https://api.openai.com/v1"

as it's hardcoded and there's no comment on where it comes from or if it can be overridden.

My use case is that I want to use https://docs.lambdalabs.com/public-cloud/lambda-inference-api/ which has a different API base:

openai_api_key = "<API-KEY>"
openai_api_base = "https://api.lambdalabs.com/v1"

client = OpenAI(
    api_key=openai_api_key,
    base_url=openai_api_base,
)