Code

[Model] Add FP8 kv cache for Qwen2#5656

Code

Merged

comaniac merged 1 commit intovllm-project:mainvllm-project/vllm:mainfrom neuralmagic:qwen2-fp8-kvcacheneuralmagic/nm-vllm:qwen2-fp8-kvcacheCopy head branch name to clipboardJun 19, 2024

+14

Commits

Commits on Jun 18, 2024

• Add FP8 kv cache for Qwen2

  mgoin

  committed
  3fb9034

  Copy full SHA for 3fb9034