Update regression metadata #1038

mfeurer · 2020-12-16T13:18:54Z

No description provided.

… problems

Was generated by running * each dataset on the metrics given in 01_create_commands.py * configuration ran for 2 days * extracted the best configuration from all runs for a dataset for that specific metric * using 209 datasets described by Feurer et al. (2020) for classification * using 111 datasets for regression. They were not carefully selected, but only briefly checked to not collide with openml/automlbenchmark#187

codecov · 2020-12-16T13:23:58Z

Codecov Report

Merging #1038 (38b80b3) into development (77ac6b5) will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@               Coverage Diff               @@
##           development    #1038      +/-   ##
===============================================
+ Coverage        85.55%   85.56%   +0.01%     
===============================================
  Files              127      127              
  Lines            10125    10123       -2     
===============================================
  Hits              8662     8662              
+ Misses            1463     1461       -2

Impacted Files	Coverage Δ
autosklearn/automl.py	`85.00% <100.00%> (+0.27%)`	⬆️
...mponents/feature_preprocessing/nystroem_sampler.py	`85.29% <0.00%> (-5.89%)`	⬇️
...ine/components/feature_preprocessing/kernel_pca.py	`94.73% <0.00%> (-1.76%)`	⬇️
...learn/pipeline/components/regression/libsvm_svr.py	`90.24% <0.00%> (-1.22%)`	⬇️
...omponents/data_preprocessing/data_preprocessing.py	`90.32% <0.00%> (-1.08%)`	⬇️
...osklearn/metalearning/metafeatures/metafeatures.py	`94.72% <0.00%> (-0.16%)`	⬇️
autosklearn/smbo.py	`82.63% <0.00%> (+0.34%)`	⬆️
...ipeline/components/regression/gradient_boosting.py	`92.30% <0.00%> (+2.88%)`	⬆️
..._preprocessing/select_percentile_classification.py	`89.65% <0.00%> (+6.89%)`	⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 77ac6b5...38b80b3. Read the comment docs.

mfeurer added 5 commits December 13, 2020 12:35

update OpenML task IDs for regression metadata

c163a9d

additional classification dataset?

28b031c

replace shutil.copytree by subprocess.run+cp to accomodate for beegfs…

5dc7f48

… problems

better testing command

1959ea6

mfeurer merged commit 9f677e1 into development Dec 16, 2020

mfeurer deleted the update_regression_metadata branch December 16, 2020 15:36

github-actions bot pushed a commit that referenced this pull request Dec 16, 2020

Matthias Feurer: Update regression metadata (#1038)

e34973a

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update regression metadata #1038

Update regression metadata #1038

mfeurer commented Dec 16, 2020

codecov bot commented Dec 16, 2020 •

edited

Loading

Update regression metadata #1038

Update regression metadata #1038

Conversation

mfeurer commented Dec 16, 2020

codecov bot commented Dec 16, 2020 • edited Loading

Codecov Report

codecov bot commented Dec 16, 2020 •

edited

Loading