Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I get the test accuracy of action recognition benchmark? #27

Open
Hou9612 opened this issue Apr 14, 2022 · 1 comment
Open

How can I get the test accuracy of action recognition benchmark? #27

Hou9612 opened this issue Apr 14, 2022 · 1 comment

Comments

@Hou9612
Copy link

Hou9612 commented Apr 14, 2022

Thanks for this wonderful work!
I can't find the ground truth file of test dataset in this repository and the competition EPIC-KITCHENS-55 Action Recognition has ended, so how can I get the test accuracy of action recognition benchmark? I want to get the test accuracy of my model both on epic-kitchens-55 and epic-kitchens-100 datasets.

@dimadamen
Copy link

You can evaluate on the test sets through submitting to the leaderboards. The leaderboard fr EPIC-KITCHENS-55 Action Recognition is available here:
https://competitions.codalab.org/competitions/20115

@AntonyPapadakis
Copy link

Hello there! Thank you for creating and maintaining a great project!
In my case I am working with a subset ,i.e., some of the kitchens, of the epic-kitchens-55 dataset. I think I need ground truth test action labels, since I am not using the entire dataset to perform my experiments. Basically, I want to calculate accuracy on certain kitchens and not the whole dataset, so I guess the leaderboard option will not do. How can I get the the test accuracy in my case using a subset of the published test data ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants