Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot get 100% accuracy despite cheating #63

Open
CodeOfDuty44 opened this issue Aug 17, 2022 · 1 comment
Open

Cannot get 100% accuracy despite cheating #63

CodeOfDuty44 opened this issue Aug 17, 2022 · 1 comment
Assignees

Comments

@CodeOfDuty44
Copy link

CodeOfDuty44 commented Aug 17, 2022

I tried to get 100% accuracy out of curiosity. For this reason I created a fake sequence of length 10 and set the anchor for the first frame only. I then performed "vot evaluate myTracker" and got the results. Result txt consists of predicted bbox values, except for first line, which is "1" instead of "x1,y1,w,h" values. Then I changed every line except for the first line to the corresponding groundtruth values, that is to say, I tried to cheat and get 100% accuracy.

However I got 0.9 accuracy. Suspecting first line related issues, I did the same for fake sequence of length 20, and I got 0.95 accuracy this time. It seems that vot toolkit also expects first line of generated result file to be the corresponding groundtruth as well. But this requires me to run my tracker on the frame I used to initialize it, which is a little bit strange and does not quite make sense. Do I need to generate and report the result for the initialization frame as well, or is this some kind of bug? Do I miss something?

Thanks in advance.

@lukacu
Copy link
Collaborator

lukacu commented Sep 27, 2022

Hm, thanks for this "cheating", it is indeed strange that you cannot get 100% score. We will check it out and let you know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants