Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Interval schedule should take start time from the request, should not… #1040

Merged

Conversation

ikibo
Copy link
Contributor

@ikibo ikibo commented Nov 14, 2023

Interval schedule should take start_time from the request, and should not set it to the current time of request execution.

Issue #1039

Description of changes:
When creating a Rollup with interval schedule defined, schedule.start_time will be assigned a value defined in the request. Before the fix schedule.start_time was assigned current time of create Rollup request execution.

CheckList:

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

bowenlan-amzn
bowenlan-amzn previously approved these changes Nov 14, 2023
jowg-amazon
jowg-amazon previously approved these changes Nov 14, 2023
Copy link

codecov bot commented Nov 14, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (59cf8dd) 74.81% compared to head (4758e48) 74.82%.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #1040      +/-   ##
============================================
+ Coverage     74.81%   74.82%   +0.01%     
- Complexity     2787     2790       +3     
============================================
  Files           366      366              
  Lines         16422    16422              
  Branches       2342     2342              
============================================
+ Hits          12286    12288       +2     
+ Misses         2835     2834       -1     
+ Partials       1301     1300       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@bowenlan-amzn
Copy link
Member

@ikibo seems one IT is broken, please take a look

@ikibo ikibo dismissed stale reviews from jowg-amazon and bowenlan-amzn via ea3c73b November 21, 2023 23:16
… set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <[email protected]>
… about what it should test.

Signed-off-by: Oleg Kravchuk <[email protected]>
@ikibo ikibo force-pushed the index-rollup-schedue-start-time branch from ea3c73b to d7e0a1a Compare November 21, 2023 23:41
@ikibo ikibo requested a review from bowenlan-amzn November 22, 2023 00:23
Signed-off-by: Oleg Kravchuk <[email protected]>
@@ -330,7 +330,7 @@ data class Rollup(
// TODO: Make startTime public in Job Scheduler so we can just directly check the value
if (seqNo == SequenceNumbers.UNASSIGNED_SEQ_NO || primaryTerm == SequenceNumbers.UNASSIGNED_PRIMARY_TERM) {
if (schedule is IntervalSchedule) {
schedule = IntervalSchedule(Instant.now(), schedule.interval, schedule.unit, schedule.delay ?: 0)
schedule = IntervalSchedule(schedule.startTime ?: Instant.now(), schedule.interval, schedule.unit, schedule.delay ?: 0)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bowenlan-amzn I will remove this null check. It is not necessary. And we did not break anything. The schedule is parsed earlier in this method on line 286 , and in this line the NPE is thrown if schedule.startTime == null(https://github.com/opensearch-project/index-management/blob/59cf8dd54b9617f0bc161a0e9b653529442f8e70/src/main/kotlin/org/opensearch/indexmanagement/rollup/model/Rollup.kt#L286C1-L286C32)

I checked it. I removed my changes and sent transform with schedule.start_time : null. Got 400 : numeric field may not be null.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see, thanks, previously I thought this schedule field is optional, but turns out this is a required field, and schedule startTime is also required, which means user has to provide some long values here anyway. So I guess this has been a bad user experience till now, and we are just making it more reasonable.

@@ -387,7 +387,7 @@ data class Transform(
if (seqNo == SequenceNumbers.UNASSIGNED_SEQ_NO || primaryTerm == SequenceNumbers.UNASSIGNED_PRIMARY_TERM) {
// we instantiate the start time
if (schedule is IntervalSchedule) {
schedule = IntervalSchedule(schedule.startTime, schedule.interval, schedule.unit)
schedule = IntervalSchedule(schedule.startTime ?: Instant.now(), schedule.interval, schedule.unit)
Copy link
Contributor Author

@ikibo ikibo Nov 22, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bowenlan-amzn I will remove this null check, the same story as with rollup.

- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <[email protected]>
@ikibo ikibo requested a review from bowenlan-amzn November 22, 2023 14:22
Copy link
Member

@bowenlan-amzn bowenlan-amzn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

@ikibo ikibo requested a review from jowg-amazon November 25, 2023 19:19
@jowg-amazon
Copy link
Contributor

Looks good! Thanks for making these changes @ikibo

@bowenlan-amzn bowenlan-amzn merged commit 417d0d9 into opensearch-project:main Nov 29, 2023
25 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Nov 29, 2023
#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed styling

Signed-off-by: Oleg Kravchuk <[email protected]>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
(cherry picked from commit 417d0d9)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
bowenlan-amzn pushed a commit that referenced this pull request Nov 29, 2023
#1040) (#1047)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.



* Changed the "delayed continuous execution test" to be more expressive about what it should test.



* fixed the NPE if schedule.startTime is NULL



* fixed the NPE if schedule.startTime is NULL



* fixed styling



* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test



---------


(cherry picked from commit 417d0d9)

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Joshua152 pushed a commit to Joshua152/index-management that referenced this pull request Dec 12, 2023
opensearch-project#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed styling

Signed-off-by: Oleg Kravchuk <[email protected]>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>
bowenlan-amzn added a commit that referenced this pull request Dec 12, 2023
* Added minimum timeout for transforms search of 10 minutes

Signed-off-by: Joshua Au <[email protected]>

* Extracted cancel minimum code to function

Signed-off-by: Joshua Au <[email protected]>

* Fixed transform code to use cluster setting

Signed-off-by: Joshua Au <[email protected]>

* Removed log statements

Signed-off-by: Joshua Au <[email protected]>

* Changed timeout logic

Signed-off-by: Joshua Au <[email protected]>

* Switched to basing off seconds

Signed-off-by: Joshua Au <[email protected]>

* [Feature] Support Transform as an ISM action (#760)

* Initial impl

Signed-off-by: Tanqiu Liu <[email protected]>

* fix style

Signed-off-by: Tanqiu Liu <[email protected]>

* end to end functional

Signed-off-by: Tanqiu Liu <[email protected]>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <[email protected]>

* Fix after core #8157 (#857)

Signed-off-by: bowenlan-amzn <[email protected]>

* Upgrade the backport workflow (#862)

Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Added 2.9 release notes. (#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

---------

Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Handle NPE in isRollupIndex (#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <[email protected]>

* unit test

Signed-off-by: Bryce Lampe <[email protected]>

---------

Signed-off-by: Bryce Lampe <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Fix core XcontentType refactor (#873)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix for max & min aggregations when no metric property exist (#870)

Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* core refactor change (#884)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* update backport branch name (#885)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* core refactor change (#887)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Fix breaking change by core refactor (#888)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix core breaking (#906)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Support copy alias in rollover (#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <[email protected]>

* 2.10

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Set preference to _primary when searching control-center index (#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <[email protected]>

* Use _primary_first instead

Signed-off-by: gaobinlong <[email protected]>

---------

Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Add primary first preference to all search requests (#912)

Signed-off-by: Tanqiu Liu <[email protected]>

* fix intelliJ IDEA gradle sync error (#916)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* make control center index as system index (#919)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Updates demo certs used in integ tests (#921)

Signed-off-by: Darshit Chanpura <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Added 2.10 release notes (#925)

Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Bump bwc version (#930)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <[email protected]>

* Fix DCO

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <[email protected]>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <[email protected]>

---------

Signed-off-by: Tanqiu Liu <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Bryce Lampe <[email protected]>
Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Darshit Chanpura <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Ashish Agrawal <[email protected]>
Co-authored-by: AWSHurneyt <[email protected]>
Co-authored-by: Bryce Lampe <[email protected]>
Co-authored-by: Hailong Cui <[email protected]>
Co-authored-by: Subhobrata Dey <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* [Test] increase the wait time after transform job triggered (#999)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Drafted 2.11 release notes. (#1004)

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

---------

Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Refactor change policy API and the policy in managed index to be non-null (#967)

* Refactor the policy to be non null in managed index config

Signed-off-by: bowenlan-amzn <[email protected]>

* Update

Signed-off-by: bowenlan-amzn <[email protected]>

* fix bug

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Add more error notification at fail points (#1000)

* Add more error notification at fail points

Signed-off-by: bowenlan-amzn <[email protected]>

* Handle exception gracefully

Signed-off-by: bowenlan-amzn <[email protected]>

* small fix

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* fix the race condition in test reset action start time (#1007)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Bump bwc version after 2.11 release (#1015)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* added type check for pipeline aggregator types in Transform initialization (#1014)

Signed-off-by: n-dohrmann <[email protected]>
Co-authored-by: Joanne Wang <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Improve security plugin enabling check (#1017)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Onboard jenkins prod docker images to github actions (#1025)

* Onboard jenkins prod docker images to github actions

Signed-off-by: Peter Zhu <[email protected]>

* Add more

Signed-off-by: Peter Zhu <[email protected]>

* Add more

Signed-off-by: Peter Zhu <[email protected]>

---------

Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Support switch aliases in shrink action. (#987)

Signed-off-by: Oleg Kravchuk <[email protected]>
Co-authored-by: ikibo <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Transform pipeline aggr test (#1027)

* tester code: pipeline aggr. transform job

Signed-off-by: n-dohrmann <[email protected]>

* made test case for pipeline aggregator in transform job

Signed-off-by: n-dohrmann <[email protected]>

* removed unnec. test lines

Signed-off-by: n-dohrmann <[email protected]>

* re-added method call on Transform obj

Signed-off-by: n-dohrmann <[email protected]>

---------

Signed-off-by: n-dohrmann <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Added unit test for switchAliases method. (#1035)

* Added unit test for switchAliases method.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Added unit test for switchAliases method checking the flow when switchAliases is disabled.

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036)

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Added minimum for search.cancel_after_time_interval setting for rollups (#1026)

* Added minimum for search.cancel_after_time_interval setting for rollups

Signed-off-by: Joshua Au <[email protected]>

* Added constant for cancel_after_time_interval for rollup search

Signed-off-by: Joshua Au <[email protected]>

* Handled case of default value for cancel interval

Signed-off-by: Joshua Au <[email protected]>

* Added comment explanation for default rollup cancel after time interval

Signed-off-by: Joshua Au <[email protected]>

* Fixed github workflow checks

Signed-off-by: Joshua Au <[email protected]>

---------

Signed-off-by: Joshua Au <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Update 2.11.1 release note (#1042)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Interval schedule should take start time from the request, should not… (#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed styling

Signed-off-by: Oleg Kravchuk <[email protected]>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Removed unused imports

Signed-off-by: Joshua Au <[email protected]>

---------

Signed-off-by: Joshua Au <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Bryce Lampe <[email protected]>
Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Darshit Chanpura <[email protected]>
Signed-off-by: n-dohrmann <[email protected]>
Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Oleg Kravchuk <[email protected]>
Co-authored-by: Tanqiu Liu <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Ashish Agrawal <[email protected]>
Co-authored-by: AWSHurneyt <[email protected]>
Co-authored-by: Bryce Lampe <[email protected]>
Co-authored-by: Hailong Cui <[email protected]>
Co-authored-by: Subhobrata Dey <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Co-authored-by: n-dohrmann <[email protected]>
Co-authored-by: Joanne Wang <[email protected]>
Co-authored-by: Peter Zhu <[email protected]>
Co-authored-by: Oleg Kravchuk <[email protected]>
Co-authored-by: ikibo <[email protected]>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Dec 12, 2023
* Added minimum timeout for transforms search of 10 minutes

Signed-off-by: Joshua Au <[email protected]>

* Extracted cancel minimum code to function

Signed-off-by: Joshua Au <[email protected]>

* Fixed transform code to use cluster setting

Signed-off-by: Joshua Au <[email protected]>

* Removed log statements

Signed-off-by: Joshua Au <[email protected]>

* Changed timeout logic

Signed-off-by: Joshua Au <[email protected]>

* Switched to basing off seconds

Signed-off-by: Joshua Au <[email protected]>

* [Feature] Support Transform as an ISM action (#760)

* Initial impl

Signed-off-by: Tanqiu Liu <[email protected]>

* fix style

Signed-off-by: Tanqiu Liu <[email protected]>

* end to end functional

Signed-off-by: Tanqiu Liu <[email protected]>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <[email protected]>

* Fix after core #8157 (#857)

Signed-off-by: bowenlan-amzn <[email protected]>

* Upgrade the backport workflow (#862)

Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Added 2.9 release notes. (#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

---------

Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Handle NPE in isRollupIndex (#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <[email protected]>

* unit test

Signed-off-by: Bryce Lampe <[email protected]>

---------

Signed-off-by: Bryce Lampe <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Fix core XcontentType refactor (#873)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix for max & min aggregations when no metric property exist (#870)

Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* core refactor change (#884)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* update backport branch name (#885)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* core refactor change (#887)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Fix breaking change by core refactor (#888)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix core breaking (#906)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Support copy alias in rollover (#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <[email protected]>

* 2.10

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Set preference to _primary when searching control-center index (#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <[email protected]>

* Use _primary_first instead

Signed-off-by: gaobinlong <[email protected]>

---------

Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Add primary first preference to all search requests (#912)

Signed-off-by: Tanqiu Liu <[email protected]>

* fix intelliJ IDEA gradle sync error (#916)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* make control center index as system index (#919)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Updates demo certs used in integ tests (#921)

Signed-off-by: Darshit Chanpura <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Added 2.10 release notes (#925)

Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Bump bwc version (#930)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <[email protected]>

* Fix DCO

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <[email protected]>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <[email protected]>

---------

Signed-off-by: Tanqiu Liu <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Bryce Lampe <[email protected]>
Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Darshit Chanpura <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Ashish Agrawal <[email protected]>
Co-authored-by: AWSHurneyt <[email protected]>
Co-authored-by: Bryce Lampe <[email protected]>
Co-authored-by: Hailong Cui <[email protected]>
Co-authored-by: Subhobrata Dey <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* [Test] increase the wait time after transform job triggered (#999)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Drafted 2.11 release notes. (#1004)

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

---------

Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Refactor change policy API and the policy in managed index to be non-null (#967)

* Refactor the policy to be non null in managed index config

Signed-off-by: bowenlan-amzn <[email protected]>

* Update

Signed-off-by: bowenlan-amzn <[email protected]>

* fix bug

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Add more error notification at fail points (#1000)

* Add more error notification at fail points

Signed-off-by: bowenlan-amzn <[email protected]>

* Handle exception gracefully

Signed-off-by: bowenlan-amzn <[email protected]>

* small fix

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* fix the race condition in test reset action start time (#1007)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Bump bwc version after 2.11 release (#1015)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* added type check for pipeline aggregator types in Transform initialization (#1014)

Signed-off-by: n-dohrmann <[email protected]>
Co-authored-by: Joanne Wang <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Improve security plugin enabling check (#1017)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Onboard jenkins prod docker images to github actions (#1025)

* Onboard jenkins prod docker images to github actions

Signed-off-by: Peter Zhu <[email protected]>

* Add more

Signed-off-by: Peter Zhu <[email protected]>

* Add more

Signed-off-by: Peter Zhu <[email protected]>

---------

Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Support switch aliases in shrink action. (#987)

Signed-off-by: Oleg Kravchuk <[email protected]>
Co-authored-by: ikibo <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Transform pipeline aggr test (#1027)

* tester code: pipeline aggr. transform job

Signed-off-by: n-dohrmann <[email protected]>

* made test case for pipeline aggregator in transform job

Signed-off-by: n-dohrmann <[email protected]>

* removed unnec. test lines

Signed-off-by: n-dohrmann <[email protected]>

* re-added method call on Transform obj

Signed-off-by: n-dohrmann <[email protected]>

---------

Signed-off-by: n-dohrmann <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Added unit test for switchAliases method. (#1035)

* Added unit test for switchAliases method.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Added unit test for switchAliases method checking the flow when switchAliases is disabled.

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036)

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Added minimum for search.cancel_after_time_interval setting for rollups (#1026)

* Added minimum for search.cancel_after_time_interval setting for rollups

Signed-off-by: Joshua Au <[email protected]>

* Added constant for cancel_after_time_interval for rollup search

Signed-off-by: Joshua Au <[email protected]>

* Handled case of default value for cancel interval

Signed-off-by: Joshua Au <[email protected]>

* Added comment explanation for default rollup cancel after time interval

Signed-off-by: Joshua Au <[email protected]>

* Fixed github workflow checks

Signed-off-by: Joshua Au <[email protected]>

---------

Signed-off-by: Joshua Au <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Update 2.11.1 release note (#1042)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Interval schedule should take start time from the request, should not… (#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed styling

Signed-off-by: Oleg Kravchuk <[email protected]>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Removed unused imports

Signed-off-by: Joshua Au <[email protected]>

---------

Signed-off-by: Joshua Au <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Bryce Lampe <[email protected]>
Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Darshit Chanpura <[email protected]>
Signed-off-by: n-dohrmann <[email protected]>
Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Oleg Kravchuk <[email protected]>
Co-authored-by: Tanqiu Liu <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Ashish Agrawal <[email protected]>
Co-authored-by: AWSHurneyt <[email protected]>
Co-authored-by: Bryce Lampe <[email protected]>
Co-authored-by: Hailong Cui <[email protected]>
Co-authored-by: Subhobrata Dey <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Co-authored-by: n-dohrmann <[email protected]>
Co-authored-by: Joanne Wang <[email protected]>
Co-authored-by: Peter Zhu <[email protected]>
Co-authored-by: Oleg Kravchuk <[email protected]>
Co-authored-by: ikibo <[email protected]>
(cherry picked from commit 60a8513)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
jowg-amazon added a commit that referenced this pull request Dec 12, 2023
)

* Added minimum timeout for transforms search of 10 minutes



* Extracted cancel minimum code to function



* Fixed transform code to use cluster setting



* Removed log statements



* Changed timeout logic



* Switched to basing off seconds



* [Feature] Support Transform as an ISM action (#760)

* Initial impl



* fix style



* end to end functional



* ISM transform unit tests & integ tests



* Fix after core #8157 (#857)



* Upgrade the backport workflow (#862)




* Added 2.9 release notes. (#851)

* Added 2.9 release notes.



* Added 2.9 release notes.



* Added 2.9 release notes.



---------




* Handle NPE in isRollupIndex (#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.



* unit test



---------





* Fix core XcontentType refactor (#873)




* fix for max & min aggregations when no metric property exist (#870)




* core refactor change (#884)




* update backport branch name (#885)




* core refactor change (#887)




* Fix breaking change by core refactor (#888)




* fix core breaking (#906)




* Support copy alias in rollover (#907)

* Support copy alias in rollover



* 2.10



---------




* Set preference to _primary when searching control-center index (#911)

* Set preference to _primary when searching control-center index



* Use _primary_first instead



---------




* Add primary first preference to all search requests (#912)



* fix intelliJ IDEA gradle sync error (#916)




* make control center index as system index (#919)




* Updates demo certs used in integ tests (#921)




* Added 2.10 release notes (#925)




* Bump bwc version (#930)




* fix integ tests; upgrade mappings versions



* Fix DCO



* Addressed pr comments; Add integ test case for re-execute the same transform action



* Addressed detekt error



* Added ISMTransform writeable test



* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase



---------




















* [Test] increase the wait time after transform job triggered (#999)




* Drafted 2.11 release notes. (#1004)

* Drafted 2.11 release notes.



* Drafted 2.11 release notes.



---------




* Refactor change policy API and the policy in managed index to be non-null (#967)

* Refactor the policy to be non null in managed index config



* Update



* fix bug



---------




* Add more error notification at fail points (#1000)

* Add more error notification at fail points



* Handle exception gracefully



* small fix



---------




* fix the race condition in test reset action start time (#1007)




* Bump bwc version after 2.11 release (#1015)




* added type check for pipeline aggregator types in Transform initialization (#1014)





* Improve security plugin enabling check (#1017)




* Onboard jenkins prod docker images to github actions (#1025)

* Onboard jenkins prod docker images to github actions



* Add more



* Add more



---------




* Support switch aliases in shrink action. (#987)





* Transform pipeline aggr test (#1027)

* tester code: pipeline aggr. transform job



* made test case for pipeline aggregator in transform job



* removed unnec. test lines



* re-added method call on Transform obj



---------




* Added unit test for switchAliases method. (#1035)

* Added unit test for switchAliases method.



* Added unit test for switchAliases method checking the flow when switchAliases is disabled.



---------




* Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036)




* Added minimum for search.cancel_after_time_interval setting for rollups (#1026)

* Added minimum for search.cancel_after_time_interval setting for rollups



* Added constant for cancel_after_time_interval for rollup search



* Handled case of default value for cancel interval



* Added comment explanation for default rollup cancel after time interval



* Fixed github workflow checks



---------





* Update 2.11.1 release note (#1042)




* Interval schedule should take start time from the request, should not… (#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.



* Changed the "delayed continuous execution test" to be more expressive about what it should test.



* fixed the NPE if schedule.startTime is NULL



* fixed the NPE if schedule.startTime is NULL



* fixed styling



* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test



---------




* Removed unused imports



---------




























(cherry picked from commit 60a8513)

Signed-off-by: Joshua Au <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Bryce Lampe <[email protected]>
Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Darshit Chanpura <[email protected]>
Signed-off-by: n-dohrmann <[email protected]>
Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Tanqiu Liu <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Ashish Agrawal <[email protected]>
Co-authored-by: AWSHurneyt <[email protected]>
Co-authored-by: Bryce Lampe <[email protected]>
Co-authored-by: Hailong Cui <[email protected]>
Co-authored-by: Subhobrata Dey <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Co-authored-by: n-dohrmann <[email protected]>
Co-authored-by: Joanne Wang <[email protected]>
Co-authored-by: Peter Zhu <[email protected]>
Co-authored-by: Oleg Kravchuk <[email protected]>
Co-authored-by: ikibo <[email protected]>
Joshua152 pushed a commit to Joshua152/index-management that referenced this pull request Dec 22, 2023
opensearch-project#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed styling

Signed-off-by: Oleg Kravchuk <[email protected]>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
Joshua152 added a commit to Joshua152/index-management that referenced this pull request Dec 22, 2023
…-project#1033)

* Added minimum timeout for transforms search of 10 minutes

Signed-off-by: Joshua Au <[email protected]>

* Extracted cancel minimum code to function

Signed-off-by: Joshua Au <[email protected]>

* Fixed transform code to use cluster setting

Signed-off-by: Joshua Au <[email protected]>

* Removed log statements

Signed-off-by: Joshua Au <[email protected]>

* Changed timeout logic

Signed-off-by: Joshua Au <[email protected]>

* Switched to basing off seconds

Signed-off-by: Joshua Au <[email protected]>

* [Feature] Support Transform as an ISM action (opensearch-project#760)

* Initial impl

Signed-off-by: Tanqiu Liu <[email protected]>

* fix style

Signed-off-by: Tanqiu Liu <[email protected]>

* end to end functional

Signed-off-by: Tanqiu Liu <[email protected]>

* ISM transform unit tests & integ tests

Signed-off-by: Tanqiu Liu <[email protected]>

* Fix after core #8157 (opensearch-project#857)

Signed-off-by: bowenlan-amzn <[email protected]>

* Upgrade the backport workflow (opensearch-project#862)

Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Added 2.9 release notes. (opensearch-project#851)

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Added 2.9 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

---------

Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Handle NPE in isRollupIndex (opensearch-project#855)

* Handle NPE in isRollupIndex

`metadata.index()` can return `null`, so handle that case by returning
`false`.

Signed-off-by: Bryce Lampe <[email protected]>

* unit test

Signed-off-by: Bryce Lampe <[email protected]>

---------

Signed-off-by: Bryce Lampe <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Fix core XcontentType refactor (opensearch-project#873)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix for max & min aggregations when no metric property exist (opensearch-project#870)

Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* core refactor change (opensearch-project#884)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* update backport branch name (opensearch-project#885)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* core refactor change (opensearch-project#887)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Fix breaking change by core refactor (opensearch-project#888)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix core breaking (opensearch-project#906)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Support copy alias in rollover (opensearch-project#907)

* Support copy alias in rollover

Signed-off-by: bowenlan-amzn <[email protected]>

* 2.10

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Set preference to _primary when searching control-center index (opensearch-project#911)

* Set preference to _primary when searching control-center index

Signed-off-by: gaobinlong <[email protected]>

* Use _primary_first instead

Signed-off-by: gaobinlong <[email protected]>

---------

Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Add primary first preference to all search requests (opensearch-project#912)

Signed-off-by: Tanqiu Liu <[email protected]>

* fix intelliJ IDEA gradle sync error (opensearch-project#916)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* make control center index as system index (opensearch-project#919)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Updates demo certs used in integ tests (opensearch-project#921)

Signed-off-by: Darshit Chanpura <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Added 2.10 release notes (opensearch-project#925)

Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* Bump bwc version (opensearch-project#930)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>

* fix integ tests; upgrade mappings versions

Signed-off-by: Tanqiu Liu <[email protected]>

* Fix DCO

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed pr comments; Add integ test case for re-execute the same transform action

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed detekt error

Signed-off-by: Tanqiu Liu <[email protected]>

* Added ISMTransform writeable test

Signed-off-by: Tanqiu Liu <[email protected]>

* Addressed comments; Moved updateTransformStartTime to IndexManagementRestTestCase

Signed-off-by: Tanqiu Liu <[email protected]>

---------

Signed-off-by: Tanqiu Liu <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Bryce Lampe <[email protected]>
Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Darshit Chanpura <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Ashish Agrawal <[email protected]>
Co-authored-by: AWSHurneyt <[email protected]>
Co-authored-by: Bryce Lampe <[email protected]>
Co-authored-by: Hailong Cui <[email protected]>
Co-authored-by: Subhobrata Dey <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* [Test] increase the wait time after transform job triggered (opensearch-project#999)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Drafted 2.11 release notes. (opensearch-project#1004)

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

* Drafted 2.11 release notes.

Signed-off-by: AWSHurneyt <[email protected]>

---------

Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Refactor change policy API and the policy in managed index to be non-null (opensearch-project#967)

* Refactor the policy to be non null in managed index config

Signed-off-by: bowenlan-amzn <[email protected]>

* Update

Signed-off-by: bowenlan-amzn <[email protected]>

* fix bug

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Add more error notification at fail points (opensearch-project#1000)

* Add more error notification at fail points

Signed-off-by: bowenlan-amzn <[email protected]>

* Handle exception gracefully

Signed-off-by: bowenlan-amzn <[email protected]>

* small fix

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* fix the race condition in test reset action start time (opensearch-project#1007)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Bump bwc version after 2.11 release (opensearch-project#1015)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* added type check for pipeline aggregator types in Transform initialization (opensearch-project#1014)

Signed-off-by: n-dohrmann <[email protected]>
Co-authored-by: Joanne Wang <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Improve security plugin enabling check (opensearch-project#1017)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Onboard jenkins prod docker images to github actions (opensearch-project#1025)

* Onboard jenkins prod docker images to github actions

Signed-off-by: Peter Zhu <[email protected]>

* Add more

Signed-off-by: Peter Zhu <[email protected]>

* Add more

Signed-off-by: Peter Zhu <[email protected]>

---------

Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Support switch aliases in shrink action. (opensearch-project#987)

Signed-off-by: Oleg Kravchuk <[email protected]>
Co-authored-by: ikibo <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Transform pipeline aggr test (opensearch-project#1027)

* tester code: pipeline aggr. transform job

Signed-off-by: n-dohrmann <[email protected]>

* made test case for pipeline aggregator in transform job

Signed-off-by: n-dohrmann <[email protected]>

* removed unnec. test lines

Signed-off-by: n-dohrmann <[email protected]>

* re-added method call on Transform obj

Signed-off-by: n-dohrmann <[email protected]>

---------

Signed-off-by: n-dohrmann <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Added unit test for switchAliases method. (opensearch-project#1035)

* Added unit test for switchAliases method.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Added unit test for switchAliases method checking the flow when switchAliases is disabled.

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Interval schedule should take start time from the request, should not set it to the current time of request execution. (opensearch-project#1036)

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Added minimum for search.cancel_after_time_interval setting for rollups (opensearch-project#1026)

* Added minimum for search.cancel_after_time_interval setting for rollups

Signed-off-by: Joshua Au <[email protected]>

* Added constant for cancel_after_time_interval for rollup search

Signed-off-by: Joshua Au <[email protected]>

* Handled case of default value for cancel interval

Signed-off-by: Joshua Au <[email protected]>

* Added comment explanation for default rollup cancel after time interval

Signed-off-by: Joshua Au <[email protected]>

* Fixed github workflow checks

Signed-off-by: Joshua Au <[email protected]>

---------

Signed-off-by: Joshua Au <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Update 2.11.1 release note (opensearch-project#1042)

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Interval schedule should take start time from the request, should not… (opensearch-project#1040)

* Interval schedule should take start time from the request, should not set it to the current time of request execution.

Signed-off-by: Oleg Kravchuk <[email protected]>

* Changed the "delayed continuous execution test" to be more expressive about what it should test.

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed the NPE if schedule.startTime is NULL

Signed-off-by: Oleg Kravchuk <[email protected]>

* fixed styling

Signed-off-by: Oleg Kravchuk <[email protected]>

* - removed null checks from RollUp and Transforms
- fixed comments in the "delayed execution" test

Signed-off-by: Oleg Kravchuk <[email protected]>

---------

Signed-off-by: Oleg Kravchuk <[email protected]>
Signed-off-by: Joshua Au <[email protected]>

* Removed unused imports

Signed-off-by: Joshua Au <[email protected]>

---------

Signed-off-by: Joshua Au <[email protected]>
Signed-off-by: Tanqiu Liu <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Ashish Agrawal <[email protected]>
Signed-off-by: AWSHurneyt <[email protected]>
Signed-off-by: Bryce Lampe <[email protected]>
Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: Subhobrata Dey <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Darshit Chanpura <[email protected]>
Signed-off-by: n-dohrmann <[email protected]>
Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Oleg Kravchuk <[email protected]>
Co-authored-by: Tanqiu Liu <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Ashish Agrawal <[email protected]>
Co-authored-by: AWSHurneyt <[email protected]>
Co-authored-by: Bryce Lampe <[email protected]>
Co-authored-by: Hailong Cui <[email protected]>
Co-authored-by: Subhobrata Dey <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Co-authored-by: n-dohrmann <[email protected]>
Co-authored-by: Joanne Wang <[email protected]>
Co-authored-by: Peter Zhu <[email protected]>
Co-authored-by: Oleg Kravchuk <[email protected]>
Co-authored-by: ikibo <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants