Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

随着训练过程模型性能变化 #51

Open
luluaa opened this issue Mar 6, 2022 · 3 comments
Open

随着训练过程模型性能变化 #51

luluaa opened this issue Mar 6, 2022 · 3 comments

Comments

@luluaa
Copy link

luluaa commented Mar 6, 2022

您好！非常感谢您们团队的工作！
我有一个不太理解的现象想请教一下您，就是我在跑vit_base的时候发现模型的性能相比起以前的resnet框架好像很快达到了饱和状态，比如在第10个epo的时候在market的mAP就已经达到了80.6，后面就变化的比较慢，另外两个数据集也会这样子。用resnet跑的话它一开始性能虽然不高但是是有比较明显的上升趋势的，请问这种现象要怎么理解呢
@michuanhaohao
Copy link
Collaborator

ViT拟合能力比较强，所以前期收敛的比较快。另外我们优化器和学习率设置不太一样，可能也是一个原因。

@luluaa
Copy link
Author

luluaa commented Mar 9, 2022

谢谢！我回头看看优化器学习率设置的影响。如果我想试着把它应用在目前的一些基于聚类的无监督的框架上的话，如果拟合能力太强其实会不会就不太好，因为可能会拟合在前期标签还不太好的情况

@michuanhaohao
Copy link
Collaborator

无监督上可能是个问题，可以研究一下，我们之前没有深究这个问题

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@michuanhaohao @luluaa