-
Notifications
You must be signed in to change notification settings - Fork 42
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FIX use balanced accuracy from scikit-learn #128
base: master
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you check on the mouse cytometry starting kit if the new score is equivalent to the old score? Also maybe sampling some of the user submissions. https://www.ramp.studio/problems/mouse_cytometry
In scikit-learn, they consider this score meaningful only in binary classification. So it will not work for multiclass. |
In fact, this the reason it is failing on iris (more over iris is fully balanced so not sure it is meaninful to use it there) |
And the discussion to make it multiclass is there: |
I don't want to get into these debates now, just make sure it is backward compatible. It would probably be better to create a new score, like |
I checked. It is back compatible for multi-class apparently and does not give bad results for the binary case. But I would need a bit more time to check. |
Basically the only thing is to expose the |
ok |
Codecov Report
@@ Coverage Diff @@
## master #128 +/- ##
==========================================
- Coverage 93.82% 93.78% -0.04%
==========================================
Files 101 101
Lines 3092 3107 +15
==========================================
+ Hits 2901 2914 +13
- Misses 191 193 +2
Continue to review full report at Codecov.
|
c970190
to
12512a3
Compare
closes #127