Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AttributeError: 'DeepSpeedCPUAdam' object has no attribute 'ds_opt_adam' #351

Open
qiankunlee opened this issue Jul 10, 2024 · 1 comment

Comments

@qiankunlee
Copy link

AttributeError: 'DeepSpeedCPUAdam' object has no attribute 'ds_opt_adam'
我使用bash finetune.sh的时候一直出现上面这些问题,反复安装不同版本还是不对,请问如何解决这个问题?

@3h2b
Copy link

3h2b commented Jul 10, 2024

AttributeError: 'DeepSpeedCPUAdam' object has no attribute 'ds_opt_adam' 我使用bash finetune.sh的时候一直出现上面这些问题,反复安装不同版本还是不对,请问如何解决这个问题?

出现这个问题一般是你的pytorch和cuda版本不对应,需要进一步检查你的pytorh版本并寻找对应的cuda版本。
反复安装不对也可能是在更换版本时卸载不完全,可以找到cuda对应版本的pytorch后手动下载适配的torchversion等工具包

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants