Unconditional Image Generation with provided noisy laten image or Image2Image without prompt

[youyinnn]

Hi there.

I am looking for how to generate an image with an unconditional diffusion manner that is able to provide a noisy image.
Or, as an image task but without a prompt, the prompt requires a trained domain-specific NLP model, I suppose (but it's not available in our case).

Any ideas?

[youyinnn]

Also, what about the custom scheduler? I want to customize the noise generation during the prediction, not the training. Is there a way to do that?

[tolgacangoz]

Hi @youyinnn,
Could you examine an unconditional image generation pipeline's code to directly reason about it? Do you want to provide the latents variable on your own?
By saying Image2Image without a prompt, are you referring to image variations?

[youyinnn]

Hello, thanks for the resources. I think what I mean is more of an image variation or reconstruction. The only purpose is to give the model a corrupted or masked image, and I want the model to generate a variation based on that.

I just had a quick look at the two links you provided. For the first one, I think I can try to have the actual sample here laten and have my own scheduler (to generate the custom noise), right?

The image variation is also similar to what I need.

Thank you again.