Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Adding failed_category_count to model_size_stats #55716

Merged
merged 2 commits into from
Apr 25, 2020

Conversation

droberts195
Copy link
Contributor

The failed_category_count statistic records the number of times
categorization wanted to create a new category but couldn't
because the job had reached its model_memory_limit.

Relates elastic/ml-cpp#1130

The failed_category_count statistic records the number of times
categorization wanted to create a new category but couldn't
because the job had reached its model_memory_limit.

Relates elastic/ml-cpp#1130
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

@@ -603,6 +603,17 @@ If `true`, the output excludes interim results. By default, interim results are
included.
end::exclude-interim-results[]

tag::failed-category-count[]
The number of times that categorization wanted to create a new category but
couldn't because the job had hit its `model_memory_limit`. This number can
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This number can be higher... could be anywhere between 1 and failed-category-count.

Is this a really important detail that folks are likely to be confused about? If not, I think those sentences could be shortened to something like this:

This count does not track which specific categories failed to be created.

If we need to explain why that's important, perhaps another sentence could be added like this: Therefore you cannot use this value to determine the number of unique categories that were missed(?).

@droberts195 droberts195 merged commit dcb6ed0 into elastic:master Apr 25, 2020
@droberts195 droberts195 deleted the failed_category_count_stat branch April 25, 2020 07:01
droberts195 added a commit to droberts195/elasticsearch that referenced this pull request Apr 25, 2020
The failed_category_count statistic records the number of times
categorization wanted to create a new category but couldn't
because the job had reached its model_memory_limit.

Backport of elastic#55716
droberts195 added a commit that referenced this pull request Apr 25, 2020
The failed_category_count statistic records the number of times
categorization wanted to create a new category but couldn't
because the job had reached its model_memory_limit.

Backport of #55716
russcam added a commit to elastic/elasticsearch-net that referenced this pull request Jun 24, 2020
Relates: elastic/elasticsearch#55716, #4803

This commit adds FailedCategoryCount to ModelSizeStats
and adds other missing fields to JobStats
russcam added a commit to elastic/elasticsearch-net that referenced this pull request Jun 29, 2020
Relates: elastic/elasticsearch#55716, #4803

This commit adds FailedCategoryCount to ModelSizeStats
and adds other missing fields to JobStats
github-actions bot pushed a commit to elastic/elasticsearch-net that referenced this pull request Jun 29, 2020
Relates: elastic/elasticsearch#55716, #4803

This commit adds FailedCategoryCount to ModelSizeStats
and adds other missing fields to JobStats
github-actions bot pushed a commit to elastic/elasticsearch-net that referenced this pull request Jun 29, 2020
Relates: elastic/elasticsearch#55716, #4803

This commit adds FailedCategoryCount to ModelSizeStats
and adds other missing fields to JobStats
russcam added a commit to elastic/elasticsearch-net that referenced this pull request Jun 29, 2020
Relates: elastic/elasticsearch#55716, #4803

This commit adds FailedCategoryCount to ModelSizeStats
and adds other missing fields to JobStats

Co-authored-by: Russ Cam <[email protected]>
russcam added a commit to elastic/elasticsearch-net that referenced this pull request Jun 30, 2020
Relates: elastic/elasticsearch#55716, #4803

This commit adds FailedCategoryCount to ModelSizeStats
and adds other missing fields to JobStats

Co-authored-by: Russ Cam <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants