Code

Length masking for batch inputs#1173

Code

Merged

barronalex merged 5 commits intomainml-explore/mlx-examples:mainfrom cache-lengthsml-explore/mlx-examples:cache-lengthsCopy head branch name to clipboardDec 19, 2024

+191-72

Commits

Commits on Dec 18, 2024

• length masking

  

  Alex Barron

  committed
  c5ce9a3

  Copy full SHA for c5ce9a3

• add mask to mlx_lm model interface

  

  Alex Barron

  committed
  cd9dcf0

  Copy full SHA for cd9dcf0

• remove lengths

  

  Alex Barron

  committed
  ef895f6

  Copy full SHA for ef895f6

• fix test:

  

  Alex Barron

  committed
  eb9452b

  Copy full SHA for eb9452b

Commits on Dec 19, 2024

• comment + fix

  

  Alex Barron

  committed
  5b414dd

  Copy full SHA for 5b414dd