Replies: 29 comments 29 replies
-
Error in Preprocessor, Please help. |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
=====
|
Beta Was this translation helpful? Give feedback.
-
Any idea if this can be implemented in ControlNet? |
Beta Was this translation helpful? Give feedback.
-
So... I assume, that this thing is only for powerful GPU's...? It took almost 13 minutes to generate image, based on a 3 image Multi-input on RTX 3080 Ti. Also, multi-input is only enough for one generation. Second attempt ends with OutOfMemoryError: CUDA out of memory. |
Beta Was this translation helpful? Give feedback.
-
thanks for your work @huchenlei . pulid works well resambling the face and impression from the initial photo(s), but it seems - contrary to face id - you cannot change that (for example: smiling, laughing etc). also the eye color did not change with prompting in my first test. |
Beta Was this translation helpful? Give feedback.
-
Please file this issue in PuLID repo: https://github.com/ToTheBeginning/PuLID Personally I think PuLID is a very strong model which can be less flexible. |
Beta Was this translation helpful? Give feedback.
-
Which folder to put it in EVA02_CLIP_L_336_psz14_s6B.pt |
Beta Was this translation helpful? Give feedback.
-
Error Please Help me |
Beta Was this translation helpful? Give feedback.
-
|
Beta Was this translation helpful? Give feedback.
-
Multi-input doesn't seem to work, the module use in fact the image from the single-input tab (if there is one already set). |
Beta Was this translation helpful? Give feedback.
-
webui-forge does not support PuliD, use a1111 webui发自我的荣耀手机-------- 原始邮件 --------发件人: Hoodad Mehrbod ***@***.***>日期: 2024年5月9日周四 傍晚6:52收件人: Mikubill/sd-webui-controlnet ***@***.***>抄送: JIAOJIAYUASD ***@***.***>, Comment ***@***.***>主 题: Re: [Mikubill/sd-webui-controlnet] [1.1.447] PuLID (Discussion #2841)
it doesnt work on forge...any one knows why?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you commented.Message ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
How is this different from the IP-Adapter FaceId method? |
Beta Was this translation helpful? Give feedback.
-
After several tests, the eyes are often completely failed, and the skin is very smooth, not too realistic. |
Beta Was this translation helpful? Give feedback.
-
It runs very slow on my PC, as does any SDXL models. Would be great to have the option of SD 1.5 too. |
Beta Was this translation helpful? Give feedback.
-
any plan for 1.5?? |
Beta Was this translation helpful? Give feedback.
-
What's the problem with this? How to solve it? |
Beta Was this translation helpful? Give feedback.
-
Great work! Do you mind also introduce how to use it via API? |
Beta Was this translation helpful? Give feedback.
-
get error:
config: How to fix it? |
Beta Was this translation helpful? Give feedback.
-
在SD中根本不能用 |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
This is a genius extension. Thank you very much I love it. |
Beta Was this translation helpful? Give feedback.
-
I'm getting the following error message, kindly help: @huchenlei Model loaded in 9.1s (load config: 1.8s, create model: 1.5s, apply weights to model: 5.4s, move model to device: 0.1s, calculate empty prompt: 0.1s). |
Beta Was this translation helpful? Give feedback.
-
|
Beta Was this translation helpful? Give feedback.
-
WHAT IS THE FOLDER LOCATION TO PUT THE FILE IN THE COMFUI MODEL FOLDER?: ip-adapter_pulid_sdxl_fp16.safetensors ? |
Beta Was this translation helpful? Give feedback.
-
·comfyui/models/pulid/
…---Original---
From: ***@***.***>
Date: Fri, Jul 26, 2024 06:03 AM
To: ***@***.***>;
Cc: ***@***.******@***.***>;
Subject: Re: [Mikubill/sd-webui-controlnet] [1.1.447] PuLID (Discussion #2841)
WHAT IS THE FOLDER LOCATION TO PUT THE FILE IN THE COMFUI MODEL FOLDER?: ip-adapter_pulid_sdxl_fp16.safetensors ?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.Message ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
Beta Was this translation helpful? Give feedback.
-
Overview
PuLID is an ip-adapter alike method to restore facial identity. It uses both insightface embedding and CLIP embedding similar to what ip-adapter faceid plus model does. However, there is an extra process of masking out the face from background environment using facexlib before passing image to CLIP. PuLID also uses Eva CLIP instead of normal CLIP. In the attn overrides, PuLID also does something more than IPAdapter, as it zero pads the tensor and adds to ortho of hidden states. If you are interested you can read their paper on how this is handled.
How to use
Install sd-webui-controlnet-evaclip extension
PuLID uses both evaclip embedding and insightface embedding as proj module input. So in order to use the feature, you need to install https://github.com/huchenlei/sd-webui-controlnet-evaclip extension.
Download Model
You can download fp16 model here: https://huggingface.co/huchenlei/ipadapter_pulid/resolve/main/ip-adapter_pulid_sdxl_fp16.safetensors
ControlNet Unit Setting
There is an extra radio group to let you select PuLID mode. According to my testing, they only make slight difference, but still something nice to have.
Example
Input
Output [Fidelity]:
Output [Style]:
Generation params
Multiple inputs
Note
Comparing to instant id, you need stronger prompt to make the output stylized. Following is the same neon style generated by instant id:
Known issue
facexlib and evaclip in total consumes about 2~3GB of vram. So if you have low vram, that can be an issue. There is also about 500MB of vram not unloaded after unloading the preprocessors. I will need to investigate more on why vram here is not properly freed.
Beta Was this translation helpful? Give feedback.
All reactions