Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Note - AMD ROCm 6.2 performance issues #392

Closed
NinjaPerson24119 opened this issue Oct 31, 2024 · 1 comment
Closed

Note - AMD ROCm 6.2 performance issues #392

NinjaPerson24119 opened this issue Oct 31, 2024 · 1 comment

Comments

@NinjaPerson24119
Copy link

NinjaPerson24119 commented Oct 31, 2024

Just a note on poor xttsv2 performance on AMD with ROCm 6.2. Doesn't seem like an issue with AllTalk necessarily.

  • EndeavourOS (Arch)
  • AMD 7900 XTX
  • Beta version
  • Standalone version

Running a simple sentence "Where am I?" takes 3s on my CPU (Intel 12700k), and 5s on the GPU. This is greatly exacerbated on larger inputs.

Downgrading to ROCm 6.0 results in <1s inference time.

Classic AMD.

@erew123
Copy link
Owner

erew123 commented Oct 31, 2024

@NinjaPerson24119 Thanks for the note on that as I dont have an AMD card, so cant test these things. Ill add a note linking back here to a couple of places on the site.

Really appreciated

Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants