add planning work nodes to model #715

ylwu-amzn · 2023-01-31T06:22:27Z

Signed-off-by: Yaliang Wu [email protected]

Description

[Describe what this change achieves]

Issues Resolved

[List any issues this PR will resolve]

Check List

New functionality includes testing.
- All tests pass
New functionality has been documented.
- New functionality has javadoc added
Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Yaliang Wu <[email protected]>

dhrubo-os

Don't we need to add any test for this?

Signed-off-by: Yaliang Wu <[email protected]>

ylwu-amzn · 2023-01-31T19:33:18Z

Don't we need to add any test for this?

The current test already covered. Just add some assertions.

codecov-commenter · 2023-01-31T19:49:23Z

Codecov Report

Merging #715 (da46d5c) into 2.x (1bf57c5) will increase coverage by 0.60%.
The diff coverage is 100.00%.

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

@@             Coverage Diff              @@
##                2.x     #715      +/-   ##
============================================
+ Coverage     84.34%   84.95%   +0.60%     
- Complexity     1052     1076      +24     
============================================
  Files            99      100       +1     
  Lines          3833     3921      +88     
  Branches        352      371      +19     
============================================
+ Hits           3233     3331      +98     
+ Misses          450      433      -17     
- Partials        150      157       +7

Flag	Coverage Δ
ml-commons	`84.95% <100.00%> (+0.60%)`	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...earch/ml/action/load/TransportLoadModelAction.java	`84.07% <100.00%> (+0.28%)`	⬆️
.../cluster/MLCommonsClusterManagerEventListener.java	`67.64% <0.00%> (-11.77%)`	⬇️
...va/org/opensearch/ml/rest/RestMLProfileAction.java	`94.62% <0.00%> (-3.46%)`	⬇️
...arch/ml/action/profile/MLProfileModelResponse.java	`100.00% <0.00%> (ø)`
.../java/org/opensearch/ml/utils/RestActionUtils.java	`81.63% <0.00%> (+0.38%)`	⬆️
...java/org/opensearch/ml/profile/MLModelProfile.java	`62.96% <0.00%> (+16.66%)`	⬆️
...g/opensearch/ml/profile/MLPredictRequestStats.java	`77.27% <0.00%> (+20.45%)`	⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

* add planning work nodes to model Signed-off-by: Yaliang Wu <[email protected]> * add test Signed-off-by: Yaliang Wu <[email protected]> --------- Signed-off-by: Yaliang Wu <[email protected]> (cherry picked from commit 46a8d6a)

* add planning work nodes to model Signed-off-by: Yaliang Wu <[email protected]> * add test Signed-off-by: Yaliang Wu <[email protected]> --------- Signed-off-by: Yaliang Wu <[email protected]> (cherry picked from commit 46a8d6a) Co-authored-by: Yaliang Wu <[email protected]>

* add planning work nodes to model Signed-off-by: Yaliang Wu <[email protected]> * add test Signed-off-by: Yaliang Wu <[email protected]> --------- Signed-off-by: Yaliang Wu <[email protected]>

…in (#711) * [wjunshen] #N/A feat: fix after the latest rebase Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: fix after rebase Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: fix after rebase Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: fix after rebase Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: fix after the latest rebase Signed-off-by: wujunshen <[email protected]> * Increment version to 2.6.0-SNAPSHOT (#671) Signed-off-by: opensearch-ci-bot <[email protected]> Signed-off-by: opensearch-ci-bot <[email protected]> Co-authored-by: opensearch-ci-bot <[email protected]> Signed-off-by: wujunshen <[email protected]> * fix profile API in example doc (#712) Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: wujunshen <[email protected]> * change model url to public repo in text embedding model example doc (#713) Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: wujunshen <[email protected]> * Enhance profile API to add model centric result controlled by view parameter (#714) * Enhance profile API to add model centric result controled by view paramter Signed-off-by: Zan Niu <[email protected]> * Enhance profile API to add model centric result controled by view parameter Signed-off-by: Zan Niu <[email protected]> * Enhance profile API to add model centric result controled by view parameter Signed-off-by: Zan Niu <[email protected]> --------- Signed-off-by: Zan Niu <[email protected]> Signed-off-by: wujunshen <[email protected]> * add planning work nodes to model (#715) * add planning work nodes to model Signed-off-by: Yaliang Wu <[email protected]> * add test Signed-off-by: Yaliang Wu <[email protected]> --------- Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: wujunshen <[email protected]> * skip running syncup job if no model index (#717) Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: wujunshen <[email protected]> * refactor: add DL model class (#722) * refactor: add DL model class Signed-off-by: Yaliang Wu <[email protected]> * fix model url in example doc Signed-off-by: Yaliang Wu <[email protected]> * address comments Signed-off-by: Yaliang Wu <[email protected]> * fix failed ut Signed-off-by: Yaliang Wu <[email protected]> --------- Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: wujunshen <[email protected]> * tune model config: change pooling mode to optional (#724) Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: make the log readable Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: add error log Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: Refer to PR #717,just checking if index exists in cluster metadata Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: change RunTimeException to MLException Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: also consider COMPLETED_WITH_ERROR Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: remove ML_MODEL_RELOAD_MAX_RETRY_TIMES in CommonValue.java Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: remove Result class Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: change "reload" and "retry" to a full word Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: change log info sentence Signed-off-by: wujunshen <[email protected]> * [wjunshen] #N/A feat: code format Signed-off-by: wujunshen <[email protected]> * [Signed-off-by: wjunshen<[email protected]>] #N/A feat: 1. Let the collection just have all ids of ml node 2. print out full exception stack trace Signed-off-by: wujunshen <[email protected]> * [Signed-off-by: wjunshen<[email protected]>] #N/A feat: use LOAD_THREAD_POOL to replace generic Signed-off-by: wujunshen <[email protected]> * [Signed-off-by: wjunshen<[email protected]>] #N/A feat: print the whole exception stack Signed-off-by: wujunshen <[email protected]> * [Signed-off-by: wjunshen<[email protected]>] #N/A feat: change the IndexNotFoundException to MLException Signed-off-by: wujunshen <[email protected]> * [Signed-off-by: wjunshen<[email protected]>] #N/A feat: add logs when receiving indexRequestBuilder.execute exception Signed-off-by: wujunshen <[email protected]> * [Signed-off-by: wjunshen<[email protected]>] #N/A feat: change the test code after code review Signed-off-by: wujunshen <[email protected]> --------- Signed-off-by: wujunshen <[email protected]> Signed-off-by: opensearch-ci-bot <[email protected]> Signed-off-by: Yaliang Wu <[email protected]> Signed-off-by: Zan Niu <[email protected]> Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> Co-authored-by: opensearch-ci-bot <[email protected]> Co-authored-by: Yaliang Wu <[email protected]> Co-authored-by: zane-neo <[email protected]>

* add planning work nodes to model Signed-off-by: Yaliang Wu <[email protected]> * add test Signed-off-by: Yaliang Wu <[email protected]> --------- Signed-off-by: Yaliang Wu <[email protected]>

add planning work nodes to model

75abb24

Signed-off-by: Yaliang Wu <[email protected]>

ylwu-amzn requested a review from a team January 31, 2023 06:22

dhrubo-os reviewed Jan 31, 2023

View reviewed changes

jngz-es previously approved these changes Jan 31, 2023

View reviewed changes

add test

da46d5c

Signed-off-by: Yaliang Wu <[email protected]>

ylwu-amzn dismissed jngz-es’s stale review via da46d5c January 31, 2023 19:28

dhrubo-os approved these changes Jan 31, 2023

View reviewed changes

b4sjoo approved these changes Jan 31, 2023

View reviewed changes

ylwu-amzn merged commit 46a8d6a into opensearch-project:2.x Jan 31, 2023

ylwu-amzn added enhancement New feature or request backport 2.5 labels Jan 31, 2023

opensearch-trigger-bot bot mentioned this pull request Feb 1, 2023

[Backport 2.5] add planning work nodes to model #719

Merged

ylwu-amzn mentioned this pull request Mar 4, 2023

[Backport to main] Backport changes from 2.x to main #782

Merged

5 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add planning work nodes to model #715

add planning work nodes to model #715

ylwu-amzn commented Jan 31, 2023

dhrubo-os left a comment

ylwu-amzn commented Jan 31, 2023

codecov-commenter commented Jan 31, 2023 •

edited

Loading

add planning work nodes to model #715

add planning work nodes to model #715

Conversation

ylwu-amzn commented Jan 31, 2023

Description

Issues Resolved

Check List

dhrubo-os left a comment

Choose a reason for hiding this comment

ylwu-amzn commented Jan 31, 2023

codecov-commenter commented Jan 31, 2023 • edited Loading

Codecov Report

codecov-commenter commented Jan 31, 2023 •

edited

Loading