Pyidaungsu 0.0.7
Happy Thingyan Festival!
syllabify()
function is replaced withtokenize()
function instead. See usage in README.md- added 3 more supported languages for syllable-level tokenization (Karen, Mon, Shan)
- word-level tokenization can be used in
tokenize()
function. Available for Burmese language only. - remove complicated zg<=>uni conversion code and replaced with simpler one using regular expression
- added Apache NOTICE in LICENSE file