Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

overlap threshold {0.5, 0.25, 0.25} need to be changed as official {0.7, 0.5, 0.5} #2

Open
nyg2017 opened this issue Sep 20, 2018 · 3 comments

Comments

@nyg2017
Copy link

nyg2017 commented Sep 20, 2018

There is a problem in eval code(evaluate_object_3d_offline.cpp), the overlap threshold should be changed as official {0.7, 0.5, 0.5}. Now it's {0.5, 0.25, 0.25}(for 3d and image/ground plane).

@pyun-ram
Copy link
Owner

pyun-ram commented Dec 5, 2018

The minimum overlap threshold for 2D evaluation on the image/ground plane and 3D evaluation is indeed
0.7, 0.5, 0.5 for car class. Please check again. :)

@nyg2017
Copy link
Author

nyg2017 commented Dec 5, 2018

The minimum overlap threshold for 2D evaluation on the image/ground plane and 3D evaluation is indeed
0.7, 0.5, 0.5 for car class. Please check again. :)

why the code in FL3D/VoxelNet/kitti_eval/evaluate_object_3d_offline.cpp
line54 is:
const double MIN_OVERLAP[3][3] = {{0.7, 0.5, 0.5}, {0.5, 0.25, 0.25}, {0.5, 0.25,0.25}};`
and I evaluate the validation dataset by the evaluate code of project "qianguih/voxelnet".
It's totally different.

@pyun-ram
Copy link
Owner

pyun-ram commented Dec 5, 2018

In MIN_OVERLAP Matrix: {{0.7, 0.5, 0.5}, {0.5, 0.25, 0.25}, {0.5, 0.25,0.25}},
each row is for a specific task: 2D evaluation on the image plane, 2D evaluation on the ground plane and 3D evaluation.
Each column is for a specific class: car, pedestrian, cyclist.
This code coincides with https://github.com/prclibo/kitti_eval.
Of course, you can change this cpp for whatever you need. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants