Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DevTask] Add DWPose version of Openpose preprocessor #1855

Closed
huchenlei opened this issue Aug 3, 2023 · 3 comments · Fixed by #1856
Closed

[DevTask] Add DWPose version of Openpose preprocessor #1855

huchenlei opened this issue Aug 3, 2023 · 3 comments · Fixed by #1856
Labels
enhancement New feature or request

Comments

@huchenlei
Copy link
Collaborator

huchenlei commented Aug 3, 2023

https://github.com/IDEA-Research/DWPose
shows really promising results on more accurate pose detection with openpose output, especially on hands.

We should port the implementation and make it available in the ControlNet extension.

@huchenlei huchenlei added the enhancement New feature or request label Aug 3, 2023
@huchenlei huchenlei changed the title [DevTask] Add DWPose version of Openpose preprocessor and model [DevTask] Add DWPose version of Openpose preprocessor Aug 3, 2023
@huchenlei
Copy link
Collaborator Author

huchenlei commented Aug 3, 2023

As a side note, we should consider re-train the ControlNet openpose model with DWPose annotated data, as previously the annotation results are not very accuate, which results openpose hand skelelton has weak control on result image.

IDEA-Research/DWPose#2

@lllyasviel to see if he has any interests on doing that re-train.

@2blackbar
Copy link

Training with feet would be great

@tanghengjian
Copy link

hi @2blackbar
i tested the controlnet openpose will not accurately produce similar number persons, such as the origial pose has three persons, while the output inference has four persons.
So i want to re-train the openpose model with multi persons cases. Could the loss only care about the image's pose rather not the original full image pixel info?
Any suggestions would be greatly appreciated!!!thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants