Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RTX3080 - MultiGPU? #31

Open
Moonlight63 opened this issue Aug 31, 2023 · 1 comment
Open

RTX3080 - MultiGPU? #31

Moonlight63 opened this issue Aug 31, 2023 · 1 comment

Comments

@Moonlight63
Copy link

First, I love this project. I have seen what others are making with it and it seems really powerful for fine tuning exactly the prompt you want.
The only way I have been able to get this to run locally on my 3080 10G is by lowering the resolution in the prompt to 352, 1 batch. It looks like others have gotten it to work, but is everyone just using colab? I'd like to run it locally. I have 2 3080s so theoretically I should have enough vram between them, but it looks like this isn't set up to train on both. I tried to add this myself with using torches DataParallel, but unfortunately I have no idea what I am doing when it comes to coding ML stuff yet. Any chance of getting multigpu to work or any advise on lowering vram usage?
@erocle
Copy link

erocle commented Nov 5, 2023

I don't code at all for this type of stuff so can't help you but I have a single 8GB 3070 and train up to 768x locally just fine?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Moonlight63 @erocle