Code

[pull] master from mudler:master#118

Code

Merged

pull[bot] merged 2 commits intokp-forks:masterkp-forks/LocalAI:masterfrom mudler:mastermudler/LocalAI:masterCopy head branch name to clipboardDec 6, 2024

+16-3

Commits

Commits on Dec 6, 2024

• chore: ⬆️ Update ggerganov/llama.cpp to c9c6e01daedac542b174c235872569fce5385982 (#4328)

  Show description for 88737e1
  

  localai-bot

  and

  mudler

  authored
  88737e1

• feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache (#4329)

  Show description for d4c1746
  mudler

  authored
  d4c1746