[Flux ControlNet] Add support for de-distilled models with CFG

[simbrams]

Flux with Inpaiting and ControlNet currently yields bad result with the base model.

To echo this comment, using de-distilled models could potentially help getting better outputs.

Currently the Flux ControlNet pipelines do not support models like https://huggingface.co/nyanko7/flux-dev-de-distill

[asomoza]

Anyone wants to contribute with this? This should be a community pipeline in the meantime until we find if the new models are good and get popular, but this could produce better results than the current ones.

Also maybe someone can test this in ComfyUI and see if it makes a big difference.

[ighoshsubho]

Anyone wants to contribute with this? This should be a community pipeline in the meantime until we find if the new models are good and get popular, but this could produce better results than the current ones.

Also maybe someone can test this in ComfyUI and see if it makes a big difference.

will take this up 😊

[charchit7]

Hey, @ighoshsubho wanna collab on this?

[ighoshsubho]

Hey, @ighoshsubho wanna collab on this?

sure

[taneeshamadhu18]

Anyone wants to contribute with this? This should be a community pipeline in the meantime until we find if the new models are good and get popular, but this could produce better results than the current ones.

Also maybe someone can test this in ComfyUI and see if it makes a big difference.
yes i would love to contribute on this

[a-r-r-o-w]

Gentle ping @ighoshsubho

[ighoshsubho]

@a-r-r-o-w I apologize, due to unexpected time constraints with my primary work commitments, I won't be able to give this the attention it deserves. Please feel free to reassign this to another contributor who can dedicate the proper time and effort to implement this feature.

[KarthikSundar2002]

I will give this issue a look, and I will start with testing this out in ComfyUI