Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create simple example and doc for naive early stopping #1476

Merged
merged 6 commits into from
Jun 14, 2022

Conversation

eddiebergman
Copy link
Contributor

Documents the get_trials_callback functionality a little more and makes it more flexible by only requiring a callable instead of having to instantiate the SMAC callback object.

Should not change existing behaviour as we only wrap the call part and forward the args.

@codecov
Copy link

codecov bot commented May 13, 2022

Codecov Report

Merging #1476 (3a4776c) into development (0b5fa19) will decrease coverage by 0.22%.
The diff coverage is 100.00%.

@@               Coverage Diff               @@
##           development    #1476      +/-   ##
===============================================
- Coverage        84.06%   83.84%   -0.23%     
===============================================
  Files              151      153       +2     
  Lines            11448    11682     +234     
  Branches          1988     2039      +51     
===============================================
+ Hits              9624     9795     +171     
- Misses            1297     1340      +43     
- Partials           527      547      +20     

Impacted file tree graph

doc/manual.rst Outdated Show resolved Hide resolved
autosklearn/automl.py Outdated Show resolved Hide resolved
@mfeurer
Copy link
Contributor

mfeurer commented Jun 7, 2022

Hey, are you sure this is ready for review? All tests are failing at the moment.

@eddiebergman
Copy link
Contributor Author

Github actions was being very weird that day, we'll try try to rerun them and see what happens

@eddiebergman
Copy link
Contributor Author

Hypothesis was correct, they all passed when I reran them, I also included a test to increase code coverage

Copy link
Contributor

@mfeurer mfeurer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Requesting changes because the documentation building is failing.

@eddiebergman
Copy link
Contributor Author

eddiebergman commented Jun 8, 2022

Tests are now failing (I guess due to OpenML), this will have to stall

@eddiebergman eddiebergman linked an issue Jun 10, 2022 that may be closed by this pull request
@eddiebergman eddiebergman self-assigned this Jun 10, 2022
@eddiebergman eddiebergman added this to the V0.15 milestone Jun 10, 2022
@eddiebergman eddiebergman added the documentation Something to be documented label Jun 10, 2022
@mfeurer mfeurer merged commit b44b1c1 into development Jun 14, 2022
@mfeurer mfeurer deleted the early_stopping_example branch June 14, 2022 12:35
eddiebergman added a commit that referenced this pull request Aug 18, 2022
* Create simple example and doc for naive early stopping

* Fix doc, pass through SMAC callbacks directly

* Fix `isinstance` check

* Add test for early stopping

* Fix signature of early stopping example/test

* Fix doc build
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Something to be documented
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Document callback functionality with SMAC
2 participants