Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend Panoptic Quality usability, functionality and testing #1511

Closed
marcocaccin opened this issue Feb 16, 2023 · 2 comments · Fixed by #1527
Closed

Extend Panoptic Quality usability, functionality and testing #1511

marcocaccin opened this issue Feb 16, 2023 · 2 comments · Fixed by #1527
Assignees
Labels
enhancement New feature or request topic: Image
Milestone

Comments

@marcocaccin
Copy link
Contributor

🚀 Feature

Expand the PanopticQuality code to

  • allow batches in input (necessary feature)
  • allow it to work on both images and point clouds (other inputs TBD)
  • do not consider never seen classes in metric computation
  • extend testing
  • [let's see if something else comes up in the discussion here]

Motivation

The just landed PanopticQuality is a welcome addition to the toolbox, but there are a number of minor issues associated with it, from deal-breaking (does not take batches as inputs) to unnecessarily restrictive (PQ is a metric for panoptic segmentation both in point cloud and image domains), to suboptimal in terms of interpretability (if a class has TP + FP + FN = 0, why should it contribute to the final metric value?)

Pitch

Let's bring in these goodies, happy to contribute 😉

Alternatives

Additional context

@marcocaccin marcocaccin added the enhancement New feature or request label Feb 16, 2023
@github-actions
Copy link

Hi! thanks for your contribution!, great first issue!

@SkafteNicki SkafteNicki added this to the v0.12 milestone Feb 17, 2023
@bhack
Copy link

bhack commented Feb 20, 2023

I will add:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request topic: Image
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants