Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Community Pipeline] Seed resize #875

Closed
osanseviero opened this issue Oct 17, 2022 · 9 comments
Closed

[Community Pipeline] Seed resize #875

osanseviero opened this issue Oct 17, 2022 · 9 comments
Assignees
Labels
community-examples hacktoberfest stale Issues that haven't received updates

Comments

@osanseviero
Copy link
Contributor

Intro

Community Pipelines are introduced in diffusers==0.4.0 with the idea of allowing the community to quickly add, integrate, and share their custom pipelines on top of diffusers.

You can find a guide about Community Pipelines here. You can also find all the community examples under examples/community/. If you have questions about the Community Pipelines feature, please head to the parent issue.

Idea: Seed Resize

Seed Resize allows generating images from a given seed at different resolutions. Usually, the generated images change as the resolution changes; with seed resize, the images look very similar. This idea is inspired by Automatic1111 UI.

@daspartho
Copy link
Contributor

Hi @osanseviero
I'd like to take on this =)

@patrickvonplaten
Copy link
Contributor

That's great! Feel free to open a PR @daspartho :-)

@daspartho
Copy link
Contributor

According to my understanding, this should allow you to generate images from known seeds at different resolutions, without changing the image as the resolution changes.

We can specify the resolution of the original image, and then all subsequent images of varying resolutions should look similar to the original image.

Could you please give me some suggestions on how i should go about implementing this?

@patrickvonplaten
Copy link
Contributor

gently ping for @osanseviero @apolinario here

@apolinario
Copy link
Collaborator

Hey @daspartho, yes that is what seed resize should do! You can check how AUTOMATIC1111 does it, I think they generate the noise on the 512x512 resolution and then resize it, which helps with keeping the seed for generating other sizes, you check their implementation here

@MarkRich
Copy link
Contributor

Took a crack at it here: #1011

@daspartho
Copy link
Contributor

So I guess I'll leave it to @MarkRich then. Good work on the pipeline!

@github-actions
Copy link

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

@github-actions github-actions bot added the stale Issues that haven't received updates label Nov 20, 2022
@osanseviero
Copy link
Contributor Author

This is done now! 🔥

PhaneeshB pushed a commit to nod-ai/diffusers that referenced this issue Mar 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
community-examples hacktoberfest stale Issues that haven't received updates
Projects
None yet
Development

No branches or pull requests

5 participants