Skip to content

Add batched_next_token() and batched_sample()#1693

Merged
apaz-cli merged 9 commits intomainfrom ap/batched_next_token_2Aug 28, 2024

Commits

Commits on Aug 22, 2024

Commits on Aug 23, 2024

Commits on Aug 27, 2024

Commits on Aug 28, 2024