Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

合并的Bug修复,等会就出来验证结果了 #14

Open
apachemycat opened this issue Jun 17, 2023 · 0 comments
Open

合并的Bug修复,等会就出来验证结果了 #14

apachemycat opened this issue Jun 17, 2023 · 0 comments

Comments

@apachemycat
Copy link

if target_model_path is not None:
print(f'Saving the target model to {target_model_path}')
model.save_pretrained(target_model_path)
base_tokenizer.save_pretrained(target_model_path)

这里还需要增加一个函数调用。
lora_model = lora_model.merge_and_unload()
merge_and_unload函数在16位加载模型的时候有用,8bit不行
下面这个不确定要不要调用
lora_model.train(False)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant