ComfyUI Support In Progress

[Kosinkadink]

Hey,

I'll have support added for FancyVideo in AnimateDiff-Evolved nodepack within the next day or two. Thanks for releasing the code and model so soon!

I'll update this issue once the port is complete.

[puffy310]

I'm very excited!

[gt732]

Subscribed!

[zeusftk]

I can't wait anymore

[Kosinkadink]

I have a question for the developers/paper authors: is it intentional that this repo and the provided models don't actually use or have any of the Cross-frame Textual Guidance? The value for cross_frame_txtattn is False for all demo configs, and the relevant keys to fill out ctm_b_self_module and ctm_b_cross_module are not present. I almost have the ComfyUI implementation finished, but it seems very odd that the special attention code the paper is dedicated to is not used at all. All of it seems to stem off of conv_in.weight modification, the motion_module (which is just finetuned AnimateDiff arch), fps_embedding, and motion_embedding.