Code

LoRA for MoE Layer#9396

Code

Merged

cuichenx merged 5 commits intomainNVIDIA/NeMo:mainfrom chcui/moe_loraNVIDIA/NeMo:chcui/moe_loraCopy head branch name to clipboardJun 11, 2024

+173-28

Commits

Commits on Jun 6, 2024

• initial moe lora impl

  Show description for 6864e22
  cuichenx

  committed
  6864e22

  Copy full SHA for 6864e22

• Apply isort and black reformatting

  Show description for cc3e60e
  cuichenx

  committed
  cc3e60e

  Copy full SHA for cc3e60e

Commits on Jun 7, 2024

• fix dangling adapter

  Show description for 5163a9b
  cuichenx

  committed
  5163a9b

  Copy full SHA for 5163a9b

• Merge branch 'main' into chcui/moe_lora

  Show description for c07de5f
  cuichenx

  authored
  c07de5f

  Copy full SHA for c07de5f

Commits on Jun 11, 2024

• update to newest mcore code

  Show description for 7ac5a5d
  cuichenx

  committed
  7ac5a5d

  Copy full SHA for 7ac5a5d