Skip to content

Commit

Permalink
set strict on sentencepiececodec
Browse files Browse the repository at this point in the history
  • Loading branch information
mittagessen committed Apr 5, 2024
1 parent 8442261 commit 17b0e48
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions kraken/lib/codec.py
Original file line number Diff line number Diff line change
Expand Up @@ -304,6 +304,8 @@ def __init__(self,
character_coverage=1.0)
self.spp = spm.SentencePieceProcessor(model_proto=_model.getvalue())

self.strict = strict

def __len__(self) -> int:
"""
Total number of input labels the codec can decode.
Expand Down

0 comments on commit 17b0e48

Please sign in to comment.