-
Notifications
You must be signed in to change notification settings - Fork 289
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Added MMTEB #275
Added MMTEB #275
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is amazing! 🚀🙌
Co-authored-by: Niklas Muennighoff <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice work, Kenneth! Especially moving the property to a parent class deduplicated a lot of code 👍
I have updated the PR. Just swinging it out for a final review, before merging it in (the discussion can still continue) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice project!
# Points | ||
|
||
| GitHub | Total points | New dataset | New task | Dataset annotations | (Bug)fixes | Running Models | Review PR | Paper Writing | Ideation | Coordination | | ||
| ----------------- | ------------ | ----------- | -------- | ------------------- | ---------- | -------------- | -------- | -------------- | -------- | ------------- | | ||
| KennethEnevoldsen | | 38 | | | | | | | | | | ||
| x-tabdeveloping | | 2 | | | | | | | | | | ||
|
||
Note that coordination and ideation is not included in the total points, but is used to determine first and last authors. | ||
|
||
# Contributor Informations | ||
|
||
First name and last name are as you want them to appear in a publication. | ||
|
||
| GitHub | First name | Last name | Email | User on openreview | | ||
| ----------------- | ---------- | ---------- | ---------------------------- | -------------------- | | ||
| KennethEnevoldsen | Kenneth | Enevoldsen | [email protected] | ~Kenneth_Enevoldsen1 | | ||
| x-tabdeveloping | Márton | Kardos | | ~Márton_Kardos1 | | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could someone help retroactively add everyone who has contributed in the past here? cc @imenelydiaker @wissam-sib
Hei everyone, will merge this in (as it is e.g. holding up other PRs), but do feel free to open new PRs with corrections |
We are getting ready to add MMTEB, so I have added it here to make sure that everything links up. I still consider it a work in progress so it is not linked it in the readme.
This PR: