Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CS224n-12 Subword Models 解决OOV问题 | 元哥的日记 #60

Open
liyuan97 opened this issue May 2, 2020 · 2 comments
Open

CS224n-12 Subword Models 解决OOV问题 | 元哥的日记 #60

liyuan97 opened this issue May 2, 2020 · 2 comments
Labels
07922184dca68f5f36757120f9cd4cd0 Gitalk

Comments

@liyuan97
Copy link
Owner

liyuan97 commented May 2, 2020

https://leeee.top/2020/CS224n-12/

Subword Models 解决OOV问题 OOV： out-of-vocabulary即单词不在词汇库里的情况之前的模型都是基于单词层面的，但是对于一个新单词“asd”没有解决方案。一个朴素的想法就是“拆分”，把长单词拆成几个单词的组合。相对于中文来说，就是一个新的词组去按照每个字的意思去理解单词的意思。下面是解决方案。
@amychu131
Copy link

支持元哥！

@liyuan97
Copy link
Owner Author

liyuan97 commented May 5, 2020

支持元哥！

😁😁😁

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
07922184dca68f5f36757120f9cd4cd0 Gitalk
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@liyuan97 @amychu131