Code

Llmblog2#16

Code

Merged

KevinMusgrave merged 36 commits intomaindetermined-ai/determined-examples:mainfrom llmblog2-profilerdetermined-ai/determined-examples:llmblog2-profilerCopy head branch name to clipboardFeb 26, 2024

+842-1

Commits

Commits on Feb 6, 2024

• working deepspeed

  aciborowska

  committed
  c7bfdba

  Copy full SHA for c7bfdba

Commits on Feb 7, 2024

• Trying out mistral

  

  KevinMusgrave

  committed
  67a9654

  Copy full SHA for 67a9654

• Move some chat formatting logic to chat_format

  

  KevinMusgrave

  committed
  047b607

  Copy full SHA for 047b607

Commits on Feb 9, 2024

• minor changes

  

  KevinMusgrave

  committed
  7a86d96

  Copy full SHA for 7a86d96

• adding scrap.py

  

  KevinMusgrave

  committed
  34ff373

  Copy full SHA for 34ff373

• get max_length

  

  KevinMusgrave

  committed
  9ba7e6b

  Copy full SHA for 9ba7e6b

Commits on Feb 12, 2024

• Get rid of max_length function

  

  KevinMusgrave

  committed
  788b170

  Copy full SHA for 788b170

• test with batch size

  

  KevinMusgrave

  committed
  8608815

  Copy full SHA for 8608815

• Test with a batch

  

  KevinMusgrave

  committed
  a90a835

  Copy full SHA for a90a835

• Add get_tokenize_fn

  

  KevinMusgrave

  committed
  341542e

  Copy full SHA for 341542e

• Added test_model back in

  

  KevinMusgrave

  committed
  5ea0939

  Copy full SHA for 5ea0939

• Add max_length back in

  

  KevinMusgrave

  committed
  c614bbe

  Copy full SHA for c614bbe

Commits on Feb 14, 2024

• lora seems to work

  

  KevinMusgrave

  committed
  b80fa15

  Copy full SHA for b80fa15

• include system prompt in user prompt for mistral

  

  KevinMusgrave

  committed
  cbde3df

  Copy full SHA for cbde3df

• check if response is in decoded

  

  KevinMusgrave

  committed
  96abc27

  Copy full SHA for 96abc27

Commits on Feb 15, 2024

• Use WarmupDecayLR

  

  KevinMusgrave

  committed
  b20e987

  Copy full SHA for b20e987

• Add lora flag to configs

  

  KevinMusgrave

  committed
  2f2d38f

  Copy full SHA for 2f2d38f

• delete test_model, move into inference.py

  

  KevinMusgrave

  committed
  0032b48

  Copy full SHA for 0032b48

Commits on Feb 16, 2024

• plot token histogram

  

  KevinMusgrave

  committed
  bd45e48

  Copy full SHA for bd45e48

• plot for num tokens before response

  

  KevinMusgrave

  committed
  7df117a

  Copy full SHA for 7df117a

• right-side padding and truncation. max_length 2048. Plot token histogram with padding and truncation

  

  KevinMusgrave

  committed
  ed845ce

  Copy full SHA for ed845ce

• profiling

  aciborowska

  committed
  7696c20

  Copy full SHA for 7696c20

Commits on Feb 21, 2024

• scrap->validate_tokenizer. Remove profiler stuff. Remove unnecessary fields from config files

  

  KevinMusgrave

  committed
  f700eda

  Copy full SHA for f700eda

• Separate folder for new blog post

  

  KevinMusgrave

  committed
  e9329d5

  Copy full SHA for e9329d5

• Updated readme

  

  KevinMusgrave

  committed
  70a8d06

  Copy full SHA for 70a8d06

Commits on Feb 22, 2024

• Manually set title

  

  KevinMusgrave

  committed
  1d0c924

  Copy full SHA for 1d0c924

Commits on Feb 26, 2024

• Apply suggestions from code review

  Show description for d4656da
  

  Kevin Musgrave

  and

  aciborowska

  authored
  d4656da

  Copy full SHA for d4656da

• Rename distributed.yaml -> lora.yaml. Remove image field in both configs

  

  KevinMusgrave

  committed
  31c8dfb

  Copy full SHA for 31c8dfb

• Use pytorch 2 image

  

  KevinMusgrave

  committed
  353939e

  Copy full SHA for 353939e

• readme: distributed.yaml -> lora.yaml

  

  KevinMusgrave

  committed
  562ef91

  Copy full SHA for 562ef91

• inference works with lora too

  

  KevinMusgrave

  committed
  e87ba2b

  Copy full SHA for e87ba2b

• minor changes to the readmes

  

  KevinMusgrave

  committed
  8919b58

  Copy full SHA for 8919b58

• Updated docker image

  

  KevinMusgrave

  committed
  d411b1f

  Copy full SHA for d411b1f

• Mention the --lora flag

  

  KevinMusgrave

  committed
  6757ee6

  Copy full SHA for 6757ee6

• Add --device argument to the inference script

  

  KevinMusgrave

  committed
  55166fa

  Copy full SHA for 55166fa

• Minor change to the readme

  

  KevinMusgrave

  committed
  955c0e0

  Copy full SHA for 955c0e0