OOM appears using DeepFloyd_IF (I use 32G video memory)

[qixuanwang-233]

As in the title, OOM appears when I use DeepFloyd IF through diffuser (I use 32GB video memory).

I used the diffuser example directly:

[Bigfield77]

Stage 3 is pretty useless, it's just a generic upscaler by stability.

does it still oom if you bypass it?

[qixuanwang-233]

Stage 3 is pretty useless, it's just a generic upscaler by stability.

does it still oom if you bypass it?

Thank you for your response, stage 3 is all I need and I solved this problem by using xFormers.

[Bigfield77]

Good for you!
Btw, how do you use xformer with deepfloyd?

*update: found it enable_xformers_memory_efficient_attention() on the pipeline

[Snimm]

@qixuanwang-233 Can you share me your exact dependencies/ requirements.txt ? I cant enable xformer I get

NotImplementedError: Memory efficient attention with `xformers` is currently not supported when `self.added_kv_proj_dim` is defined.

I cannot upgrade my pytorch because in the requirements.txt of deep floyd say it needs to be less than 2.0.0

Can you please share your requirements.txt / the dependencies you are using?