Code

Qwen dev jan25#47

Code

Merged

risingsunomi merged 3 commits intomainrisingsunomi/exo-pt:mainfrom qwen-dev-jan25risingsunomi/exo-pt:qwen-dev-jan25Copy head branch name to clipboardJan 31, 2025

+780-754

Commits

Commits on Jan 31, 2025

• adding qwen2 model, creating a general multihead attention transformal model to route needed model structure but same base mha structure, updated tests, updated inference engine, generalized some l…

  Show description for a7757d3
  risingsunomi

  committed
  a7757d3

  Copy full SHA for a7757d3

• removing duplicate mlp for single layer_mlp

  risingsunomi

  committed
  1431d48

  Copy full SHA for 1431d48

• fixes to general mha for detecting to use_tied or not

  risingsunomi

  committed
  7ad4b1c

  Copy full SHA for 7ad4b1c