Skip to content

v0.4.18 - Embeddings tokenizer and tokenization updates
Compare
Choose a tag to compare
@evaline-ju evaline-ju released this 24 Jul 21:10
· 41 commits to main since this release
v0.4.18
1499cab
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

  • Fix embedding use of tokenizer to avoid already borrowed by @markstur in #369
  • Adds tokenization task for embeddings by @flaviabeo in #365

Full Changelog: v0.4.17...v0.4.18

Contributors

markstur and flaviabeo
Assets 2
Loading