Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

18 better zh tw and zh cn conversion #20

Merged
merged 15 commits into from
May 10, 2024
Merged

18 better zh tw and zh cn conversion #20

merged 15 commits into from
May 10, 2024

Conversation

andreihar
Copy link
Owner

No description provided.

@andreihar
Improved simplified.json and removed redundant words from words.json
681b304
@andreihar
Added additional characters for simplified conversion, added Traditio…
7d34d79 
…nal characters variations
@andreihar
Added functions to handle case where traditional char maps to multipl…
b736756 
…e chars to find best solution
@andreihar
Fixed traditional and simplified datasets, fixed to_simplified for ne…
c6f2f1a 
…w dataset, improved efficiency of Converter, removed redundant words from words.josn
@andreihar
Formatted traditional.json, fixed tests
b94bc6f
@andreihar
Modified IPA for suffixes
b7b0bbe
@andreihar
Fixed entries in words.json that used POJ and had typos
1c0a4b0
@andreihar
Fixed south dialect in words.json, removed redundant entries
efb7269
@andreihar
Updated tests to account for dataset changes and IPA suffix represent…
f5772c8 
…ation
@andreihar
Changed checker function
00328f2
@andreihar
Modified Tailo, TLPA, POJ unit tests for new checker
d5eb080
@andreihar
Modified Zhuyin, Pingyim unit tests for new checker
071f77e
@andreihar
Modified IPA, Tongiong unit tests for new checker
daa8e81
@andreihar
Changed deprecated Python functions, removed simplified.json
2326603
@andreihar
Added tests for new to_traditional, to_simplified, Tokeniser
e1af27e
@andreihar andreihar linked an issue May 10, 2024 that may be closed by this pull request
Better zh_TW and zh_CN conversion #18
Closed
@andreihar andreihar self-assigned this May 10, 2024
@andreihar andreihar merged commit 0112aaf into main May 10, 2024
30 checks passed
@andreihar andreihar deleted the 18-better-zh_tw-and-zh_cn-conversion branch May 22, 2024 01:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@andreihar andreihar

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Better zh_TW and zh_CN conversion
1 participant
@andreihar