Code

Merge dev branch#5680

Code

Merged

oobabooga merged 17 commits intomainoobabooga/text-generation-webui:mainfrom devoobabooga/text-generation-webui:devCopy head branch name to clipboardMar 11, 2024

+451-337

Commits

Commits on Mar 7, 2024

• Right-truncate long chat completion prompts instead of left-truncating

  Show description for bae14c8
  oobabooga

  committed
  bae14c8

  Copy full SHA for bae14c8

• Make superbooga & superboogav2 functional again (#5656)

  oobabooga

  authored
  2681f6f

  Copy full SHA for 2681f6f

Commits on Mar 8, 2024

• Add AQLM support (transformers loader) (#5466)

  oobabooga

  authored
  0e6eb7c

  Copy full SHA for 0e6eb7c

• Bump AutoAWQ to 0.2.3 (Linux only) (#5658)

  oobabooga

  authored
  d0663ba

  Copy full SHA for d0663ba

• Move "Command for chat-instruct mode" to the main chat tab (closes #5634)

  oobabooga

  committed
  238f69a

  Copy full SHA for 238f69a

• Increase height of "Custom stopping strings" UI field

  oobabooga

  committed
  549bb88

  Copy full SHA for 549bb88

• Add back AutoAWQ for Windows

  Show description for 9271e80
  oobabooga

  committed
  9271e80

  Copy full SHA for 9271e80

Commits on Mar 9, 2024

• Add StreamingLLM for llamacpp & llamacpp_HF (2nd attempt) (#5669)

  oobabooga

  authored
  afb51bd

  Copy full SHA for afb51bd

• Optimize StreamingLLM by over 10x

  oobabooga

  committed
  cf06979

  Copy full SHA for cf06979

Commits on Mar 10, 2024

• Installer: validate the checksum for the miniconda installer on Windows

  oobabooga

  committed
  52a3492

  Copy full SHA for 52a3492

• Bump bitsandbytes to 0.43, add official Windows wheel

  oobabooga

  committed
  763f9be

  Copy full SHA for 763f9be

• Bump llama-cpp-python to 0.2.56

  oobabooga

  committed
  67b24b0

  Copy full SHA for 67b24b0

• Keep AQLM only for Linux (fails to install on Windows)

  oobabooga

  committed
  b3ade58

  Copy full SHA for b3ade58

• Add numba to requirements.txt

  oobabooga

  committed
  a102c70

  Copy full SHA for a102c70

• API: don't use settings.yaml for default values

  oobabooga

  committed
  abcdd0a

  Copy full SHA for abcdd0a

Commits on Mar 11, 2024

• Minor logging change

  oobabooga

  committed
  15d90d9

  Copy full SHA for 15d90d9

• Document StreamingLLM

  oobabooga

  committed
  0567179

  Copy full SHA for 0567179