Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it able to integrate with animatediff? #27

Open
zevcc-gh opened this issue Mar 5, 2024 · 5 comments
Open

Is it able to integrate with animatediff? #27

zevcc-gh opened this issue Mar 5, 2024 · 5 comments

Comments

@zevcc-gh
Copy link

zevcc-gh commented Mar 5, 2024

I am following
https://github.com/huchenlei/ComfyUI-layerdiffuse/tree/main?tab=readme-ov-file#generate-foreground-rgb--alpha

But switched the model to animatediff, and the error is displayed on the Layer Diffusion Decode node.

RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 36 but got size 35 for tensor number 1 in the list.
@huchenlei
Copy link
Owner

Can you share your workflow?

@dummerfranz
Copy link

is working with animatediff. not sure if node order is important tho.

workflow (2).json
readme_00001
Screenshot 2024-03-05 194617

@zevcc-gh
Copy link
Author

zevcc-gh commented Mar 6, 2024

Here is my workflow:
test_animatediff.json
for the openposeXL2, im using this: https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/tree/main

The video can be generate successfully, but failed on the postprocessing part, on the Layer Diffusion Decode node.

@huchenlei
Copy link
Owner

In the minimal animatediff workflow I cannot reproduce your issue:
image
ad.json

@zevcc-gh
Copy link
Author

zevcc-gh commented Mar 6, 2024

I have fixed my workflow but I don't know why.
I found that the image's width = 560 = 16*35, so I changed the width from 560 to 576 and it works...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants