Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DreamStudio integration #348

Merged
merged 32 commits into from
Oct 28, 2022
Merged

DreamStudio integration #348

merged 32 commits into from
Oct 28, 2022

Conversation

carson-katri
Copy link
Owner

This adds backend switching, with options "Local" and "DreamStudio" currently. In the future, other backends could be supported, such as an existing Stable Diffusion installation, HuggingFace's diffusers library, or something else.

DreamStudio setup is completely optional. However, releases will be made that only contain the dependencies necessary to run on DreamStudio (which will be much lighter weight). This will make the addon more accessible for lower-end hardware.

@carson-katri
Copy link
Owner Author

This includes a very experimental implementation of realtime viewport rendering, but it is not currently accessible in the addon. Realtime viewport is not planned for 0.0.8.

@carson-katri carson-katri added this to the v0.0.8 milestone Oct 24, 2022
Copy link
Collaborator

@NullSenseStudio NullSenseStudio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Source image will discard the generated image if Color Correct is checked. Inpainting and outpainting are generating no different from the modify option.

Copy link
Collaborator

@NullSenseStudio NullSenseStudio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes looking good so far. Just a few more issues I've found.

@carson-katri
Copy link
Owner Author

Thank you for the very thorough review!

@carson-katri carson-katri merged commit 7292910 into main Oct 28, 2022
@carson-katri carson-katri deleted the dream-studio-integration branch October 28, 2022 14:30
JasonHoku pushed a commit to JasonHoku/dream-textures that referenced this pull request Dec 20, 2022
* Redesign init image options

* Add outpainting support

* Use extended image size when outpainting

* Rename to 'Source Image'

* Only store second image when color correction is enabled

* Fix regressions in normal generation

* Add seamless_axes option

* Fix render pass

* clipseg fix (carson-katri#344)

* clipseg fix

* hanging fix

* Initial multi-backend implementation

* Almost working viewport rendering

* Improved impl

* clipseg fix (carson-katri#344)

* clipseg fix

* hanging fix

* Add Discord and release badges to README

* Use total downloads badge

* Add backend switching UI

* Add workflow for building DreamStudio-only builds

* Add stability-sdk to other requirements files

* Move realtime viewport code into separate experimental file

* Cleanup

* Disable unsupported options

* Disable upscaling panel if unsupported by backend

* Check for stable_diffusion length not existence

* Use artifact.seed and provide default backend

* Update operators/dream_texture.py

Co-authored-by: NullSenseStudio <[email protected]>

* Update generator_process/__init__.py

Co-authored-by: NullSenseStudio <[email protected]>

* Hide seamless options when using Stability SDK

Co-authored-by: NullSenseStudio <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants