Code

Llm gateway rework#3

Code

Merged

damienlaine merged 18 commits intonextlinto-ai/linto:nextfrom llm-gateway-reworklinto-ai/linto:llm-gateway-reworkCopy head branch name to clipboardJan 15, 2025

+344-47

Commits

Commits on Jan 7, 2025

• added redis broker to llm-gateway

  htagourti

  committed
  947cc0b

  Copy full SHA for 947cc0b

• removed api url from llm config

  htagourti

  committed
  8bb372b

  Copy full SHA for 8bb372b

• added the possibility to enable/disable vllm deployment

  htagourti

  committed
  54a3a36

  Copy full SHA for 54a3a36

• corrected vllm_enable variable name

  htagourti

  committed
  487ea1d

  Copy full SHA for 487ea1d

• removed redundant if statement

  htagourti

  committed
  16dc68f

  Copy full SHA for 16dc68f

• added missing env & corrected error in session-api template

  htagourti

  committed
  d1cb0cb

  Copy full SHA for d1cb0cb

• Handle new studio api environment settings

  

  Houpert

  authored and

  htagourti

  committed
  35ec020

  Copy full SHA for 35ec020

• Added streaming service khaldi and whisper

  

  Houpert

  authored and

  htagourti

  committed
  b2d4b1e

  Copy full SHA for b2d4b1e

• removed api url from llm config

  htagourti

  committed
  a480e55

  Copy full SHA for a480e55

• added the possibility to enable/disable vllm deployment

  htagourti

  committed
  1d823d2

  Copy full SHA for 1d823d2

• added missing env & corrected error in session-api template

  htagourti

  committed
  980d5a2

  Copy full SHA for 980d5a2

• added LLM gateway volume handling

  htagourti

  committed
  633fc05

  Copy full SHA for 633fc05

• removed extra / on studio-api

  htagourti

  committed
  4c313e4

  Copy full SHA for 4c313e4

• removed duplicate field in session-api

  htagourti

  committed
  05d33b0

  Copy full SHA for 05d33b0

• added new hydra conf to conf-template

  htagourti

  committed
  d373e60

  Copy full SHA for d373e60

• removed unused varaible

  htagourti

  committed
  0726492

  Copy full SHA for 0726492

• Remove test file

  htagourti

  committed
  6b6f559

  Copy full SHA for 6b6f559

Commits on Jan 13, 2025

• updated default llm config

  htagourti

  committed
  7b9c364

  Copy full SHA for 7b9c364