Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tracked mesh becomes bad since 2k steps #10

Closed
essen900718 opened this issue Oct 1, 2024 · 2 comments
Closed

Tracked mesh becomes bad since 2k steps #10

essen900718 opened this issue Oct 1, 2024 · 2 comments

Comments

@essen900718
Copy link

Dear authors,

Thanks for your work!
We've been encountered a problem with the tracker specifically the tracked mesh just becomes terribly morphed after 2k steps.
Here's the steps we did for capturing our own dataset:

  1. set up 7 cameras, do the calibration, and capturing concurrently
  2. processing step 1 without background and without color correction
    • we have checked the alpha_maps and there're no problems
  3. processing step 2 - tracking, and the problem occurs

I may append some images for illustration.

--- Step 999 --- still okay
frame_00000_999_lmk_init_all

--- Step 1499 --- also okay
frame_00000_1499_rgb_init_texture

--- Step 1999 --- already morphed
frame_00000_1999_rgb_init_all

--- afterwards --- continually worse
frame_00000_2499_rgb_init_offset

We hope to receive your comments and instructions to get through this problem! Thank you so much.

Best regards,
Isadora

@ShenhanQian
Copy link
Owner

Hi Isadora, thanks for sharing your results.

The main problem is probably a too-high regularization on the texture map. The default value is 1e5 for NeRSemble. Since you only have 7 views, about half of 16 for NeRSemble, you may try a lower value by passing --w.reg_tex_tv 3e4 or 1e4.

@essen900718
Copy link
Author

Hi Shenhan,
Thanks a lot for your reply, it has helped me a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants