Code

add moe topk(k>2) gate support#5881

Code

Merged

tohtana merged 8 commits intodeepspeedai:masterdeepspeedai/DeepSpeed:masterfrom inkcherry:topk_2inkcherry/DeepSpeed:topk_2Copy head branch name to clipboardAug 15, 2024

+131-6

Commits

Commits on Aug 8, 2024

• Mingzhi/topk prob (deepspeedai#28)

  Show description for feb505c
  

  3 peoplecommitted
  feb505c

  Copy full SHA for feb505c

• refine

  inkcherry

  committed
  153af8e

  Copy full SHA for 153af8e

• remove empty line

  inkcherry

  committed
  80a0c5f

  Copy full SHA for 80a0c5f

Commits on Aug 9, 2024

• Merge branch 'master' into topk_2

  tjruwase

  authored
  6a2b767

  Copy full SHA for 6a2b767

Commits on Aug 12, 2024

• fix format

  inkcherry

  committed
  3bea84b

  Copy full SHA for 3bea84b

Commits on Aug 14, 2024

• Merge branch 'master' into topk_2

  loadams

  authored
  5582faf

  Copy full SHA for 5582faf

• Merge branch 'master' into topk_2

  loadams

  authored
  e9409e2

  Copy full SHA for e9409e2

Commits on Aug 15, 2024

• Merge branch 'master' into topk_2

  tohtana

  authored
  cda9dd7

  Copy full SHA for cda9dd7