Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3D joints ground truth used in evaluations? #10

Open
julyiii opened this issue May 3, 2023 · 3 comments
Open

3D joints ground truth used in evaluations? #10

julyiii opened this issue May 3, 2023 · 3 comments

Comments

@julyiii
Copy link

julyiii commented May 3, 2023

Thank you for your excellent work!
I am confused by what  gt 3d joints  should be used in evalutions or in training ? GT 3d joints annotations is just from interhand dataset's 3d joints or  mano_layer forward given mano parameters from interhand dataset ? Is it relevant to what representations I use to represent hand ? Because I find the difference  between above two gt 3d joints annotations is big  and may not be ignored.
Looking forward  your reply!
@ZhengdiYu
Copy link
Owner

ZhengdiYu commented Jul 15, 2023

We follow the prior works (e.g. IntagHand) to regress the 3D joints from mano_layer. However, I've also tried using the annotations provided by InterHand dataset and it did not show significant differences in training actually. The possible reason for the difference in evaluation is more likely the GT 3d annotations will have 'valid' properties to eliminate some joints while this does not exist if we regress from mano_layer.

@julyiii
Copy link
Author

julyiii commented Jul 16, 2023

Thank you for your reply !
Regarding the “valid” annotation you mentioned, I found that different papers have different practices. The first kind of practice is that they don't use the GT 3d "valid" annotations to eliminate some joints in evaluation.(e.g. Intaghand). But The other kind of practice is that they just use corresponding GT 3d "valid" annotations for 3d joints from mano_layer.(e.g. kypt_transformer and interhand). I want to know your practice for fair comparison.

@luckyday2022
Copy link

When will the training code be released?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants