New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

loss一直不降低？怎么调参 #45

Open

cristianohello opened this issue Apr 1, 2023 · 1 comment

cristianohello commented Apr 1, 2023

loss一直不降低？怎么调参

Owner

hikariming commented Apr 1, 2023

lora的r不能太小，可以看看我的配置参数，也可以在colab上试一下，看看和你本地显存、依赖包那些有没有什么差异，有时候调参就是很玄学

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment