Word-Segmentation-BPemb-

For Myanmar Text

Usage Install BPEmb with pip:

pip install bpemb

install Anaconda install jupyter notebook

vocabulary size segmentation 1000 ['▁str', 'at', 'f', 'ord'] 3000 ['▁str', 'at', 'ford'] 5000 ['▁str', 'at', 'ford'] 10000 ['▁strat', 'ford'] 25000 ['▁stratford'] 50000 ['▁stratford'] 100000 ['▁stratford'] 200000 ['▁stratford']