Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Questions on CLIP calibration #32

Open
DianCh opened this issue Jul 17, 2021 · 1 comment
Open

Questions on CLIP calibration #32

DianCh opened this issue Jul 17, 2021 · 1 comment

Comments

@DianCh
Copy link

DianCh commented Jul 17, 2021 •
edited
Loading

Hi, I was wondering how you calculated the confidence for CLIP models with their zero-shot predictions. Specifically:

  • Did you take the softmax of the logits calculated by the following snippet (taken from the original CLIP paper)?
  • If not, could you help clarify what values are used as confidence?

Screen Shot 2021-07-17 at 11 35 19 AM

Thank you for the wonderful work of the paper!
@josipd
Copy link
Contributor

josipd commented Aug 17, 2021

Hello,

our instantiation of the CLIP model is checked in here: https://github.com/google-research/robustness_metrics/blob/5a380c4ec11fa85255b5db643c64efa42d749110/robustness_metrics/models/clip.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@josipd @DianCh