Code

Implement classifier-free guidance#2135

Code

Merged

ggerganov merged 10 commits intoggerganov:masterggerganov/llama.cpp:masterfrom bullno1:cfgbullno1/llama.cpp:cfgCopy head branch name to clipboardJul 11, 2023

+188-5

Commits

Commits on Jul 8, 2023

• Initial implementation

  bullno1

  committed
  d09d5ed

  Copy full SHA for d09d5ed

• Remove debug print

  bullno1

  committed
  4786300

  Copy full SHA for 4786300

• Restore signature of llama_init_from_gpt_params

  bullno1

  committed
  8ba5b13

  Copy full SHA for 8ba5b13

• Free guidance context

  bullno1

  committed
  8f91b52

  Copy full SHA for 8f91b52

• Make freeing of guidance_ctx conditional

  bullno1

  committed
  114d4c5

  Copy full SHA for 114d4c5

• Make Classifier-Free Guidance a sampling function

  bullno1

  committed
  422a7ff

  Copy full SHA for 422a7ff

• Correct typo. CFG already means context-free grammar.

  bullno1

  committed
  66eb048

  Copy full SHA for 66eb048

• Record sampling time in llama_sample_classifier_free_guidance

  bullno1

  committed
  8e66e59

  Copy full SHA for 8e66e59

• Shift all values by the max value before applying logsoftmax

  bullno1

  committed
  325fc88

  Copy full SHA for 325fc88

Commits on Jul 10, 2023

• Fix styling based on review

  bullno1

  committed
  abf164d

  Copy full SHA for abf164d