New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TypeError: init() got an unexpected keyword argument 'device_map' #5

Open

xiao-keeplearning opened this issue Jun 5, 2023 · 0 comments

xiao-keeplearning commented Jun 5, 2023

qlora-chinese-LLM/chat.py

Line 118 in b9495bf

    
           model = PeftModel.from_pretrained(base_model, args.lora_model, device_map='auto', )

同样的peft版本，但是会报错。您这边的环境能跑通么？
另外，删去这个参数就可以跑通了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment