Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add option to use memory efficient attention to the Diffusion UNet #210

Closed
Warvito opened this issue Jan 30, 2023 · 1 comment · Fixed by #222
Closed

Add option to use memory efficient attention to the Diffusion UNet #210

Warvito opened this issue Jan 30, 2023 · 1 comment · Fixed by #222
Assignees
@Warvito
Milestone
Version 0.2 - Tra...

Comments

@Warvito
Copy link
Collaborator

Warvito commented Jan 30, 2023

As suggested by @ericspod and @danieltudosiu , the DiffusionModelUNet should have an argument defining if it will use the memory efficient attention from cformers or not.
@Warvito
Copy link
Collaborator Author

Warvito commented Jan 30, 2023

Discussed in #192

@Warvito Warvito self-assigned this Feb 4, 2023
@Warvito Warvito linked a pull request Feb 4, 2023 that will close this issue
Add option to use flash attention #222
Merged
@Warvito Warvito mentioned this issue Feb 4, 2023
Merged
@Warvito Warvito mentioned this issue Mar 5, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Warvito Warvito

Labels
None yet
Projects
None yet
Milestone
Version 0.2 - Transformers and Anomal...
Development

Successfully merging a pull request may close this issue.

Add option to use flash attention Project-MONAI/GenerativeModels
1 participant
@Warvito