New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

这个白化方法对文本分类这样的任务有效吗 #6

Open

zwboss opened this issue Apr 16, 2021 · 2 comments

zwboss commented Apr 16, 2021

问一下剑神，我的想法是将bert当作向量抽取器，下游做分类任务，用这样的方法优化bert得到的向量对分类任务会有效果吗

Owner

bojone commented Apr 16, 2021 •

edited

Loading

不会，因为白化只是一个线性变换，而这个线性变换可以融合到最后的分类层中，所以加不加数学上都是等价的。

Author

zwboss commented Apr 16, 2021

感谢大佬解答

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment