Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation table in paper (table 1) conflicts with previous studies #6

Open
jeonghyunkeem opened this issue May 10, 2021 · 1 comment

Comments

@jeonghyunkeem
Copy link

jeonghyunkeem commented May 10, 2021

It seems the order of object category in table 1 from the paper is different from the previous studies(Scan2CAD, E2E) while values are matched perfectly.

SceneCAD: bathtub bookshelf cabinet chair display other sofa table trashbin
S2C, E2E: bath bookshelf cabinet chair display sofa table trash bin other

Is it just a mistake or is there any intention about it?

Also, how did you train an object detection network using 3D-SIS with different object labels? I guess the display and trashbin category is considered the same as otherfurniture in scannetv2. Can you provide more details about it?

@skanti
Copy link
Owner

skanti commented May 12, 2021

Hi @jeonghyunkeem,
thanks for pointing that out! It's a mistake - it should be the same class with the same values. We will try to correct it.

Regarding your 2nd question: We did not use 3D-SIS as detector. Generally in CAD alignment tasks you do not need to predict the class labels since you are going to align a CAD model to the scan and thus can simply assume the scan object has the same class as the used CAD model. Class labels in our work are used mainly for evaluation.
Hope that helps!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants