Code

Code for the llm-finetuning blog#12

Code

Merged

KevinMusgrave merged 12 commits intomaindetermined-ai/determined-examples:mainfrom KevinMusgrave/llm-finetuningdetermined-ai/determined-examples:KevinMusgrave/llm-finetuningCopy head branch name to clipboardJan 31, 2024

+332-1

Commits

Commits on Jan 26, 2024

• Code for the llm-finetuning blog

  

  KevinMusgrave

  committed
  235c751

  Copy full SHA for 235c751

Commits on Jan 29, 2024

• Updated the config

  

  KevinMusgrave

  committed
  d38cb59

  Copy full SHA for d38cb59

• Add scikit-learn to requirements

  

  KevinMusgrave

  committed
  72c7103

  Copy full SHA for 72c7103

• Use correct chat template

  

  KevinMusgrave

  committed
  207555c

  Copy full SHA for 207555c

• pass in the correct eos_token_id to model.generate

  

  KevinMusgrave

  committed
  99db947

  Copy full SHA for 99db947

• Move model and tokenizer creation into one function

  

  KevinMusgrave

  committed
  1aab507

  Copy full SHA for 1aab507

• Use new assistant prompt for completions-only collator

  

  KevinMusgrave

  committed
  a8669f2

  Copy full SHA for a8669f2

Commits on Jan 30, 2024

• Use 10k samples by default

  

  KevinMusgrave

  committed
  f81cbf1

  Copy full SHA for f81cbf1

• yaml: change name to text-to-sql and eval batch size to 4

  

  KevinMusgrave

  committed
  8924339

  Copy full SHA for 8924339

• Add new line to ASSISTANT_PROMPT

  

  KevinMusgrave

  committed
  26c2368

  Copy full SHA for 26c2368

• Updated the readme

  

  KevinMusgrave

  committed
  0ec1c87

  Copy full SHA for 0ec1c87

• Add to main readme

  

  KevinMusgrave

  committed
  79a2fe1

  Copy full SHA for 79a2fe1