Code

Mistral + Mixtral Support for NeVa#9459

Code

Merged

yaoyu-33 merged 15 commits intoNVIDIA:mainNVIDIA/NeMo:mainfrom paul-gibbons:neva_mistralpaul-gibbons/NeMo:neva_mistralCopy head branch name to clipboardJul 8, 2024

+109-16

Commits

Commits on Jun 5, 2024

• mistral template support

  Show description for a3fdb2f
  paul-gibbons

  committed
  a3fdb2f

  Copy full SHA for a3fdb2f

• get_specs neva fix

  Show description for 775d714
  paul-gibbons

  committed
  775d714

  Copy full SHA for 775d714

• mistral update

  Show description for 3f71906
  paul-gibbons

  committed
  3f71906

  Copy full SHA for 3f71906

Commits on Jun 7, 2024

• fixed mistral tokenization

  Show description for fef753e
  paul-gibbons

  committed
  fef753e

  Copy full SHA for fef753e

• text_gen_strategy add mistral support

  Show description for 6abdae1
  paul-gibbons

  committed
  6abdae1

  Copy full SHA for 6abdae1

Commits on Jun 10, 2024

• mistral text_gen fix

  Show description for fc12031
  paul-gibbons

  committed
  fc12031

  Copy full SHA for fc12031

Commits on Jun 12, 2024

• resolved merge conflict in neva_dataset.py

  Show description for bfe10d5
  paul-gibbons

  committed
  bfe10d5

  Copy full SHA for bfe10d5

• Cleaning up neva config

  Show description for 85cc3ce
  paul-gibbons

  committed
  85cc3ce

  Copy full SHA for 85cc3ce

Commits on Jun 13, 2024

• fix llama_2 default text_gen_strategy

  Show description for 41cc6ce
  paul-gibbons

  committed
  41cc6ce

  Copy full SHA for 41cc6ce

• Merge main branch 'origin/main' into neva_mistral

  paul-gibbons

  committed
  1dd20cd

  Copy full SHA for 1dd20cd

• Apply isort and black reformatting

  Show description for 051b8e7
  paul-gibbons

  committed
  051b8e7

  Copy full SHA for 051b8e7

Commits on Jun 24, 2024

• fix forward() to account for new embedding optimization in MCore

  Show description for e4eea06
  paul-gibbons

  committed
  e4eea06

  Copy full SHA for e4eea06

• Apply isort and black reformatting

  Show description for 31df937
  paul-gibbons

  committed
  31df937

  Copy full SHA for 31df937

Commits on Jun 27, 2024

• Merge branch 'main' into neva_mistral

  paul-gibbons

  authored
  93cd6a7

  Copy full SHA for 93cd6a7

Commits on Jul 2, 2024

• Merge branch 'main' into neva_mistral

  paul-gibbons

  authored
  eb345bf

  Copy full SHA for eb345bf