Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Multiphase progress reporting for data frame analyses #1179

Merged
merged 13 commits into from
May 2, 2020

Conversation

tveasey
Copy link
Contributor

@tveasey tveasey commented Apr 30, 2020

This implements phased progress reporting for data frame analytics. I've extended CDataFrameAnalysisInstrumentation to support starting progress monitoring for named tasks. In order to ensure that we always send a phase complete result I also moved the progress writing out of CDataFrameAnalyzer into CDataFrameAnalysisInstrumentation. (This seems more natural anyway.)

Copy link
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Left a couple of minor comments.

lib/maths/CBoostedTreeFactory.cc Outdated Show resolved Hide resolved
lib/maths/CBoostedTreeImpl.cc Outdated Show resolved Hide resolved
lib/maths/CBoostedTreeImpl.cc Show resolved Hide resolved
lib/maths/COutliers.cc Outdated Show resolved Hide resolved
@tveasey
Copy link
Contributor Author

tveasey commented Apr 30, 2020

Thanks @dimitris-athanasiou! I've addressed all your comments. Could you take another look.

Copy link
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tveasey
Copy link
Contributor Author

tveasey commented May 1, 2020

retest

1 similar comment
@tveasey
Copy link
Contributor Author

tveasey commented May 1, 2020

retest

@tveasey tveasey merged commit bfe6076 into elastic:master May 2, 2020
@tveasey tveasey deleted the progress-monitoring branch May 2, 2020 13:34
tveasey added a commit to tveasey/ml-cpp-1 that referenced this pull request May 4, 2020
dimitris-athanasiou added a commit to dimitris-athanasiou/elasticsearch that referenced this pull request May 4, 2020
As of elastic/ml-cpp#1179, the analytics process reports phases
depending on the analysis type. This commit adjusts the phases
of current analyses from `analyzing` to the following:

 - outlier_detection: [`computing_outlier`]
 - regression/classification: [`feature_selection`, `coarse_parameter_search`, `fine_tuning_parameters`, `final_training`]
dimitris-athanasiou added a commit to elastic/elasticsearch that referenced this pull request May 5, 2020
As of elastic/ml-cpp#1179, the analytics process reports phases
depending on the analysis type. This commit adjusts the phases
of current analyses from `analyzing` to the following:

 - outlier_detection: [`computing_outlier`]
 - regression/classification: [`feature_selection`, `coarse_parameter_search`, `fine_tuning_parameters`, `final_training`]
dimitris-athanasiou added a commit to elastic/elasticsearch that referenced this pull request May 5, 2020
As of elastic/ml-cpp#1179, the analytics process reports phases
depending on the analysis type. This commit adjusts the phases
of current analyses from `analyzing` to the following:

 - outlier_detection: [`computing_outlier`]
 - regression/classification: [`feature_selection`, `coarse_parameter_search`, `fine_tuning_parameters`, `final_training`]

Backport of #56107
2lambda123 pushed a commit to 2lambda123/elastic-elasticsearch that referenced this pull request May 2, 2024
As of elastic/ml-cpp#1179, the analytics process reports phases
depending on the analysis type. This commit adjusts the phases
of current analyses from `analyzing` to the following:

 - outlier_detection: [`computing_outlier`]
 - regression/classification: [`feature_selection`, `coarse_parameter_search`, `fine_tuning_parameters`, `final_training`]

Backport of #56107
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants