Skip to content

Commit

Permalink
Removed 的 as suffix
Browse files Browse the repository at this point in the history
  • Loading branch information
andreihar committed Jun 8, 2024
1 parent d1ff5e6 commit b6c2033
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion taibun/taibun.py
Original file line number Diff line number Diff line change
Expand Up @@ -489,7 +489,7 @@ def tokenise(self, input):
subword
for word in tokenised
for subword in (
(word[:-1], word[-1]) if (word[-1] == '的' or word[-1] == '矣') and len(word) > 1
(word[:-1], word[-1]) if (word[-1] == '矣') and len(word) > 1
else (word,)
)
]

0 comments on commit b6c2033

Please sign in to comment.