[Bug]: o3-mini - Azure OpenAI

[yigitkonur]

What happened?

Surprisingly, Azure OpenAI this time added support for the o3-mini model on the same day!

But when a request is sent with stream set to true, the ability to fake the stream that worked with o1 models (behaving as if stream were false but returning full data by SSE in single message) doesn't work here. This won't work even with enable_preview_features set to true, and was likely hardcoded only for o1 models.

To reproduce this, simply sending a request with stream set to true will be sufficient.

Request:

{
  "model": "o3-mini",
  "messages": [
    {
      "role": "user",
      "content": "Who are you?"
    }
  ],
  "frequency_penalty": 0,
  "presence_penalty": 0,
  "temperature": 1,
  "top_p": 1,
  "stream": true
}

Response:

{
  "error": {
    "message": "litellm.BadRequestError: AzureException BadRequestError - Error code: 400 - {'error': {'message': \"Unsupported value: 'stream' does not support true with this model. Supported values are: false.\", 'type': 'invalid_request_error', 'param': 'stream', 'code': 'unsupported_value', 'callstack': '  File \...]}] LiteLLM Retried: 4 times, LiteLLM Max Retries: 5",
    "type": null,
    "param": null,
    "code": "400"
  }
}

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

1.59.9

Twitter / LinkedIn details

x.com/yigitkonur