[Bug]: Incompatibility with IP-Adapter

[ronan36880]

What happened?

When using IP-Adapter-Plus and attempting to generate an image, it errors out.

Workflow is as follows (has been also attached as a workflow.json file below):

Steps to reproduce the problem

1. Take a model and apply IP-Adapter to it
2. Apply Layer Diffuse
3. Attempt to sample
4. Watch it throw an exception

What should have happened?

It should have proceeded with the generation like it does when not using something like IP-Adapter.

Commit where the problem happens

ComfyUI: 151f746
ComfyUI-layerdiffuse: dc48c4b
ComfyUI_IPAdapter_plus: 6a411dcb2c6c3b91a3aac97adfb080a77ade7d38

Sysinfo

OS: Windows 11 23H2
GPU: NVIDIA GTX 1050

Console logs

https://gist.github.com/ronan36880/7ed2f05aab2650ed33e5fb5d447214ce

Workflow json file

ip-adapter-bug.json

Additional information

No response