Add batched_next_token()
and batched_sample()
#1693
Merged
apaz-cli merged 9 commits intomainfrom ap/batched_next_token_2Aug 28, 2024
+102-2
Commits
Commits on Aug 22, 2024
- committed
- committed
Commits on Aug 23, 2024
Commits on Aug 27, 2024
- committed
- committed
- committed