[G2P] backward compatibility for english tokenizer and bugfix#5984

Merged

XuesongYang merged 1 commit intomainfrom cherry-pick-main-1fbeb7b11f9dd624d2f1fff09186badd2eeb3e92

Feb 10, 2023

+9-5

Commits on Feb 10, 2023

[G2P] added backward compatibility for english tokenizer and fixed unit tests (#5980 )

XuesongYang
authored and
web-flow
committed