Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation metrics explanation #26

Open
ojasvijain opened this issue Jan 8, 2024 · 2 comments
Open

Evaluation metrics explanation #26

ojasvijain opened this issue Jan 8, 2024 · 2 comments

Comments

@ojasvijain
Copy link

ojasvijain commented Jan 8, 2024

Hi Team,

I was wondering how you are computing the metrics for evaluation. I was going through metrics.py file and came across ap_per_class function which seems to be computing the average precision for each class in an image. (FYI - my custom dataset only has 1 class with a lot of objects of that class in a single image)
I wanted to understand what *stats is (the parameter passed in the function) in test.py? And how does it help in being able to assign a predicted class to a ground truth?

Also,
I wanted to know how you are associating a particular predicted class with a ground truth? Is it solely based on the highest iou values? If yes, what if you assign a ground truth to a particular predicted class (and eliminate it from the iteration once it is assigned) and find a higher iou to another predicted class further down the iteration?

Thanks!

@LZHgrla
Copy link
Collaborator

LZHgrla commented Jan 9, 2024

Hi, thanks!
DynamicDet's codebase is yolov7. So, recommend to ask these issue in yolov7

@ojasvijain
Copy link
Author

ojasvijain commented Jan 9, 2024

Thanks for your response. I just wanted to understand what is happening in the backend for DynamicDet - specifically with regards to the metrics.py and test.py files.
If I run the model on test data, how can I access the precision, recall etc scores?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants