Skip to content

v4.40.1: fix `EosTokenCriteria` for `Llama3` on `mps`

Compare
Choose a tag to compare
@ArthurZucker ArthurZucker released this 23 Apr 22:01
· 2020 commits to main since this release
v4.40.1
9fe3f58

Kudos to @pcuenca for the prompt fix in:

  • Make EosTokenCriteria compatible with mps #30376

To support EosTokenCriteria on MPS while pytorch adds this functionality.

Contributors

pcuenca
Assets 2
Loading