New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

全量微调 7B #1

Open

CuteMing opened this issue Jun 19, 2023 · 2 comments

CuteMing commented Jun 19, 2023

您好，请问一下全量微调7B需要多少卡，8*V100 32G 够吗

Owner

zejunwang1 commented Jun 20, 2023 •

edited

Loading

单卡 V100 可以全量微调 3B 的模型

jiangjin1999 commented Nov 11, 2023

可以啊，你开zero 2 3 什么的，两张A40可以全量调Bloom 7B

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment