Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to calculate COLMAP's AUC metrics in Table 18? #106

Open
air158 opened this issue Dec 10, 2024 · 1 comment
Open

How to calculate COLMAP's AUC metrics in Table 18? #106

air158 opened this issue Dec 10, 2024 · 1 comment

Comments

@air158
Copy link

air158 commented Dec 10, 2024

Hi,

I'm a beginner in SfM and trying to reproduce the AUC metrics for COLMAP shown in Table 18 of your paper's appendix. I see the AUC values are measured at thresholds of 1°/3°/5° for relative pose errors across all image pairs.

Could you please help explain:

  1. How to extract the relative pose errors between image pairs from COLMAP's output?
  2. What's the specific formula used to calculate the AUC values from these errors?

Any guidance or sample code would be greatly appreciated as I'm learning to evaluate SfM results.

Thank you for your time!

download

@B1ueber2y
Copy link
Member

The common practice is to compute relative pose error on exhaustive pairs and report auc on top of it. An example of how to compute the relative pose errors is here: https://github.com/cvg/limap/blob/main/limap/util/evaluation.py#L57. Thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants