Stable Diffusion via REST #1500

adodge · 2023-01-23T19:58:15Z

Hi! Thanks for this project. It's exactly the sort of thing I was looking for. I made some nodes to hook into Automatic1111.

To get it running, you have to set up the service from here: https://github.com/AUTOMATIC1111/stable-diffusion-webui and run it with ./webui.sh --api to expose the REST API. Here are some examples of it working:

- Exposes a run_async() coroutine - processed appropriately in process.py

- globals for interacting with the automatic1111 API - encoding/decoding images from the JSON - async HTTP call to the API

- Nodes interacting with the automatic1111 API - text2img, img2img, and interrogate

joeyballentine · 2023-01-23T20:08:11Z

This is really cool! Thanks!

I'm not too sure how i feel about relying on a separate server to run this stuff though. It makes sense in that it's a lot easier to not have to integrate everything directly, but i feel like it has the potential to cause lots of issues and incompatibility given enough time. For example if automatic's SD repo updates and makes breaking changes, people would need to use an old version for this to work properly.

This would however be the perfect use case for a plugin once we have the plugin system implemented, but I'll defer to @RunDevelopment on this one to see what he thinks.

joeyballentine · 2023-01-23T20:20:44Z

Skimmed through the code. I like that you put this in a separate REST category to make it clear that it's interacting with external things and not anything built into chaiNNer.

If you don't have SD running, do these nodes still show up? What happens in that case?

adodge · 2023-01-23T20:33:36Z

Thanks for taking a look! Yes, all good points.

The nodes do show up, but obviously they report an error if you try to run them. I could have it try to connect to the API when the nodes are imported.

joeyballentine · 2023-01-23T20:35:40Z

We're currently talking about this, and we feel the benefits of adding this most likely outweigh any drawbacks. Are you in our Discord server? I think it would be easier to discuss this with you there, if you don't mind

- causes the nodes to be hidden if the API isn't up - also these options might be useful later

RunDevelopment

Thank you for this @adodge! Great work!

I left you a few comments with questions and suggestions.

backend/src/nodes/impl/rest.py

backend/src/nodes/nodes/rest/__init__.py

backend/src/nodes/nodes/rest/img2img.py

backend/src/nodes/impl/rest.py

- renaming REST to External Stable Diffusion - making some text arguments optional - using sliders where appropriate - using the "seed" group - geting rid of async - we're already calling the nodes in a thread, so we don't need individual http calls to be async - replace aiohttp with requests in requirements

adodge · 2023-01-24T23:13:22Z

Implemented the feedback given. Here are some new screenshots:

joeyballentine · 2023-01-24T23:33:18Z

The results of this all still get saved by automatic's repo right? Like there's no chance someone would generate something cool but forget to save it and never be able to get it back?

I'll try this out myself when I have some time

adodge · 2023-01-24T23:47:14Z

Weirdly it doesn't save, and I don't see an option in the API to do so. Would be good to have an easy way to do something similar on the ChaiNNer side. Maybe a node that outputs the current time as text, that could be used with the save node.

There's also the problem of saving metadata. The API does give a JSON blob with metadata, so that could be an output from the SD node, and we could hook it into a "Save Text" node.

adodge · 2023-01-25T00:31:36Z

Here's a possible implementation of the saving:

It's kind of a lot of spaghetti to do something basic. Maybe there could be one node that does it all.

requirements.txt

backend/src/nodes/nodes/external_stable_diffusion/img2img.py

backend/src/nodes/impl/external_stable_diffusion.py

backend/src/nodes/nodes/external_stable_diffusion/img2img.py

- Added requests library to requirements.ts - Removed kebab case in favor of "Text to Image" - Changed LargeImageOutput to ImageOutput

adodge · 2023-01-25T19:23:20Z

Made a few more changes in response to feedback:

Added requests library to requirements.ts
Removed kebab case in favor of "Text to Image"
Changed LargeImageOutput to ImageOutput

RunDevelopment

Sorry for the delay!

One last thing for the Img2Img and Tex2Img nodes.

backend/src/nodes/nodes/external_stable_diffusion/img2img.py

RunDevelopment

Sorry about this. Last last last change request.

backend/src/nodes/nodes/external_stable_diffusion/img2img.py

- Actually looks like SD rounds down to the nearest multiple of 8 - Added slider_step and control_step to SliderInputs - Added a runtime error if an invalid value is manually entered or piped in - Would be nice if we could encode this "round down" behavior in the image_type expression of the output type, then we could get rid of the runtime error

joeyballentine · 2023-02-07T14:13:15Z

Whoops. Fix that conflict and I'll merge this

adodge · 2023-02-07T18:24:43Z

@joeyballentine Oops. Done!

joeyballentine

Awesome. Thanks again for this

adodge added 7 commits January 23, 2023 10:51

Async node base class

dcd4f8d

- Exposes a run_async() coroutine - processed appropriately in process.py

helper functions for REST

ee3ecba

- globals for interacting with the automatic1111 API - encoding/decoding images from the JSON - async HTTP call to the API

REST category

750bc81

- Nodes interacting with the automatic1111 API - text2img, img2img, and interrogate

...

f63a4b2

...

50f6577

...

1f45f35

...

45c7453

adodge added 3 commits January 23, 2023 12:59

request options from the API on import

93cac3b

- causes the nodes to be hidden if the API isn't up - also these options might be useful later

icons

ad80400

lint and black

c5f1a4f

adodge force-pushed the stable_diffusion branch from d1c3a45 to c5f1a4f Compare January 24, 2023 07:12

RunDevelopment requested changes Jan 24, 2023

View reviewed changes

adodge force-pushed the stable_diffusion branch from fa3b6be to c999e2e Compare January 24, 2023 22:31

adodge force-pushed the stable_diffusion branch from c999e2e to 4f5fae3 Compare January 24, 2023 22:33

adodge requested a review from RunDevelopment January 24, 2023 22:36

Change subcategory to "Automatic1111"

eb6e776

adodge requested review from joeyballentine and RunDevelopment and removed request for RunDevelopment and joeyballentine January 24, 2023 23:02

...

9ca754c

formatting

9a97dee

RunDevelopment reviewed Jan 25, 2023

View reviewed changes

requirements.txt Show resolved Hide resolved

backend/src/nodes/nodes/external_stable_diffusion/img2img.py Outdated Show resolved Hide resolved

backend/src/nodes/impl/external_stable_diffusion.py Show resolved Hide resolved

RunDevelopment reviewed Jan 25, 2023

View reviewed changes

backend/src/nodes/nodes/external_stable_diffusion/img2img.py Outdated Show resolved Hide resolved

Responding to feedback

5e27fe5

- Added requests library to requirements.ts - Removed kebab case in favor of "Text to Image" - Changed LargeImageOutput to ImageOutput

adodge requested a review from RunDevelopment January 25, 2023 19:22

RunDevelopment reviewed Jan 26, 2023

View reviewed changes

backend/src/nodes/nodes/external_stable_diffusion/img2img.py Outdated Show resolved Hide resolved

RunDevelopment mentioned this pull request Jan 27, 2023

add random number node #1499

Merged

adodge added 2 commits January 27, 2023 14:26

Add type hints to node output.

778c5b6

...

b6e275f

RunDevelopment requested changes Jan 28, 2023

View reviewed changes

backend/src/nodes/nodes/external_stable_diffusion/img2img.py Outdated Show resolved Hide resolved

backend/src/nodes/nodes/external_stable_diffusion/img2img.py Outdated Show resolved Hide resolved

adodge added 6 commits January 28, 2023 16:31

Informative error message when failing to connect to SD

a793a22

Remove "model checkpoint override" for now

fad46f8

Add "round down" behavior to the image_type of the outputs

a3ac22f

lint

1952d3e

Merge remote-tracking branch 'origin/main' into stable_diffusion

be30bfc

RunDevelopment previously approved these changes Feb 6, 2023

View reviewed changes

Merge branch 'main' into stable_diffusion

4fee40f

adodge dismissed RunDevelopment’s stale review via 4fee40f February 7, 2023 18:23

joeyballentine approved these changes Feb 7, 2023

View reviewed changes

joeyballentine merged commit fc9fa32 into chaiNNer-org:main Feb 7, 2023

li1i9 mentioned this pull request Apr 17, 2023

Help #1742

Closed

dlbone mentioned this pull request Apr 27, 2023

Batch images with Stable Diffusion WebUI #1765

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Stable Diffusion via REST #1500

Stable Diffusion via REST #1500

adodge commented Jan 23, 2023

joeyballentine commented Jan 23, 2023

joeyballentine commented Jan 23, 2023

adodge commented Jan 23, 2023

joeyballentine commented Jan 23, 2023

RunDevelopment left a comment

adodge commented Jan 24, 2023

joeyballentine commented Jan 24, 2023 •

edited

Loading

adodge commented Jan 24, 2023 •

edited

Loading

adodge commented Jan 25, 2023

adodge commented Jan 25, 2023

RunDevelopment left a comment •

edited

Loading

RunDevelopment left a comment

joeyballentine commented Feb 7, 2023

adodge commented Feb 7, 2023

joeyballentine left a comment

Stable Diffusion via REST #1500

Stable Diffusion via REST #1500

Conversation

adodge commented Jan 23, 2023

joeyballentine commented Jan 23, 2023

joeyballentine commented Jan 23, 2023

adodge commented Jan 23, 2023

joeyballentine commented Jan 23, 2023

RunDevelopment left a comment

Choose a reason for hiding this comment

adodge commented Jan 24, 2023

joeyballentine commented Jan 24, 2023 • edited Loading

adodge commented Jan 24, 2023 • edited Loading

adodge commented Jan 25, 2023

adodge commented Jan 25, 2023

RunDevelopment left a comment • edited Loading

Choose a reason for hiding this comment

RunDevelopment left a comment

Choose a reason for hiding this comment

joeyballentine commented Feb 7, 2023

adodge commented Feb 7, 2023

joeyballentine left a comment

Choose a reason for hiding this comment

joeyballentine commented Jan 24, 2023 •

edited

Loading

adodge commented Jan 24, 2023 •

edited

Loading

RunDevelopment left a comment •

edited

Loading