Backport/backport 15508 to 2.x #15646

sumitasr · 2024-09-04T07:17:26Z

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

Functionality includes testing.
API changes companion pull request created, if applicable.
Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…outside of the OpenSearch core (opensearch-project#14575) (opensearch-project#14579) Signed-off-by: Andriy Redko <[email protected]> (cherry picked from commit 391dee2)

…project#14566) * fix file cache initialization * changelog * add test --------- (cherry picked from commit 2be25bb) Signed-off-by: panguixin <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…ck (opensearch-project#14187) (opensearch-project#14565) * Moving query recompute out of write lock * [Tiered Caching] Moving query recomputation logic outside of write lock * Adding java doc for the completable map * Changes to call future handler only once per key * Fixing spotless check * Added changelog * Addressing comments * Fixing gradle fail * Addressing comments to refactor unit test * minor UT refactor --------- Signed-off-by: Sagar Upadhyaya <[email protected]> Signed-off-by: Sagar <[email protected]> Co-authored-by: Sagar Upadhyaya <[email protected]>

…tly (opensearch-project#14550) (opensearch-project#14589) * Fix flaky test TieredSpilloverCacheTests.testComputeIfAbsentConcurrently * Addressing comment --------- (cherry picked from commit 729276f) Signed-off-by: Sagar Upadhyaya <[email protected]> Signed-off-by: Sagar Upadhyaya <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Sagar Upadhyaya <[email protected]>

…-project#14594) (cherry picked from commit 8ad199d) Signed-off-by: Ashish Singh <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…ject#14427) (opensearch-project#14593) * Add unittests for RemoteClusterStateAttributesManager (cherry picked from commit a34270d) Signed-off-by: Shivansh Arora <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

opensearch-project#14552) (opensearch-project#14600) * Fix issue 14519:Parsing a GetResult returns NPE if found field is missing. Signed-off-by: Vatsal <[email protected]> * Fix issue 14519:Parsing a GetResult returns NPE if found field is missing. Signed-off-by: Vatsal <[email protected]> * Fix issue 14519:Fix wildcart import. Signed-off-by: Vatsal <[email protected]> * Fix issue 14519:Fix wildcart import. Signed-off-by: Vatsal <[email protected]> * Fix issue 14519:Fix spotless issues. Signed-off-by: Vatsal <[email protected]> * Fix issue 14519:update changelog --------- (cherry picked from commit c71fd4a) Signed-off-by: vatsal <[email protected]> Signed-off-by: Daniel Widdis <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Daniel Widdis <[email protected]>

…h-project#14554) (opensearch-project#14595) (cherry picked from commit 8e493f3) Signed-off-by: Liyun Xiu <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…#14597) (opensearch-project#14598) (cherry picked from commit 5c8623f) Signed-off-by: Andriy Redko <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…ository-azure (opensearch-project#14610) (opensearch-project#14616) * Bump com.microsoft.azure:msal4j in /plugins/repository-azure Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0. - [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases) - [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt) - [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0) --- updated-dependencies: - dependency-name: com.microsoft.azure:msal4j dependency-type: direct:production update-type: version-update:semver-minor ... * Updating SHAs * Update changelog --------- (cherry picked from commit 8904557) Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

…4564) (opensearch-project#14617) * Fix testInvalidInput flakiness * Addressed andrross's comment * rerun security check --------- (cherry picked from commit f9512db) Signed-off-by: Peter Alfonsi <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Peter Alfonsi <[email protected]>

…oject#14627) (cherry picked from commit f1f4f89) Signed-off-by: vatsal <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…f recursion. (opensearch-project#14200) (opensearch-project#14629) * Refactor FilterPath parse function (opensearch-project#12067) * Implement unit tests for FilterPathTests (opensearch-project#12067) * Write warn log if Filter is empty; Add comments (opensearch-project#12067) * Add changelog * Remove unnecessary log statement * Remove unused logger * Spotless apply * Remove incorrect changelog --------- (cherry picked from commit 0742453) Signed-off-by: Siddhant Deshmukh <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Robin Friedmann <[email protected]>

… RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513) (opensearch-project#14639) * Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata * Correct the check for deciding upload of hashes of consistent settings (cherry picked from commit 501a702) Signed-off-by: Sooraj Sinha <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

opensearch-project#14635) (opensearch-project#14661) * Allow system index warning * Add to CHANGELOG * Address code review comments --------- (cherry picked from commit f14b5c8) Signed-off-by: Craig Perkins <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

… in /modules/lang-mustache (opensearch-project#14672) (opensearch-project#14676) * Bump com.github.spullara.mustache.java:compiler Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14. - [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14) --- updated-dependencies: - dependency-name: com.github.spullara.mustache.java:compiler dependency-type: direct:production update-type: version-update:semver-patch ... * Updating SHAs * Update changelog --------- (cherry picked from commit ed1d852) Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

…sitory-azure (opensearch-project#14673) (opensearch-project#14678) * Bump net.minidev:accessors-smart in /plugins/repository-azure Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1. - [Release notes](https://github.com/netplex/json-smart-v2/releases) - [Commits](netplex/json-smart-v2@2.5.0...2.5.1) --- updated-dependencies: - dependency-name: net.minidev:accessors-smart dependency-type: direct:production update-type: version-update:semver-patch ... * Updating SHAs * Update changelog --------- (cherry picked from commit 41fa085) Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

… values and index_prefixes (opensearch-project#10959) (opensearch-project#14686) * Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes * Add more test * modify change log * Fix test failure * Change the indexAnalyzer used by prefix field * Skip old version for yaml test * Optimize some code * Fix test failure * Modify yaml test description * Remove the name parameter for setAnalyzer() --------- (cherry picked from commit 2e63913) Signed-off-by: Gao Binlong <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

@experimentalapi

…nsearch-project#14415) (opensearch-project#14692) * Create new extension point in SystemIndexPlugin for a single plugin to get registered system indices * Add to CHANGELOG * WIP on system indices from IndexNameExpressionResolver * Add test in IndexNameExpressionResolverTests * Remove changes in SystemIndexPlugin * Add method in IndexNameExpressionResolver to get matching system indices * Show how resolver can be chained to get system indices * Fix forbiddenApis check * Update CHANGELOG * Make SystemIndices internal * Remove unneeded changes * Fix CI failures * Fix precommit errors * Use Regex instead of WildcardMatcher * Address code review feedback * Allow caller to pass index expressions * Create SystemIndexRegistry * Update CHANGELOG * Remove singleton limitation * Add javadoc * Add @experimentalapi annotation --------- (cherry picked from commit bf56227) Signed-off-by: Craig Perkins <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…dsBalancer to filter remote search shard from relocation decision (opensearch-project#14613) (opensearch-project#14643) (cherry picked from commit 58d1164) Signed-off-by: RS146BIJAY <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…ensearch-project#14683) (cherry picked from commit 51af2e2) Signed-off-by: Shivansh Arora <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Arpit-Bandejiya <[email protected]>

…pensearch-project#14690) * Adding QueryGroup schema (opensearch-project#13669) * rebase with opensearch/main Signed-off-by: Kaushal Kumar <[email protected]> * add resourceLimitGroupId propagation logic from coordinator to data nodes Signed-off-by: Kaushal Kumar <[email protected]> * add sandbox schema Signed-off-by: Kaushal Kumar <[email protected]> * add resourceLimitGroupTests Signed-off-by: Kaushal Kumar <[email protected]> * add resourceLimitGroupMetadata tests Signed-off-by: Kaushal Kumar <[email protected]> * run spotlessApply Signed-off-by: Kaushal Kumar <[email protected]> * add mode field in ResourceLimitGroup schema Signed-off-by: Kaushal Kumar <[email protected]> * fix breaking testcases Signed-off-by: Kaushal Kumar <[email protected]> * add task cancellation skeleton Signed-off-by: Kaushal Kumar <[email protected]> * add multitenant labels in searchSource builder Signed-off-by: Kaushal Kumar <[email protected]> * write custom xcontent parser for ResourceLimitGroup Signed-off-by: Kaushal Kumar <[email protected]> * remove unrelated changes Signed-off-by: Kaushal Kumar <[email protected]> * remove non-existing import fro cluster settings Signed-off-by: Kaushal Kumar <[email protected]> * remove non releated changes Signed-off-by: Kaushal Kumar <[email protected]> * add _id as the resourceLimitGroup key Signed-off-by: Kaushal Kumar <[email protected]> * add change to register resource limit group metadata Signed-off-by: Kaushal Kumar <[email protected]> * add updatedAt in resource limit group Signed-off-by: Kaushal Kumar <[email protected]> * rename resourceLimitGroup to queryGroup Signed-off-by: Kaushal Kumar <[email protected]> * address the comments on PR Signed-off-by: Kaushal Kumar <[email protected]> * rename the mode member var to resiliency mode Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add change in CHANGELOG Signed-off-by: Kaushal Kumar <[email protected]> * add tests for custom namedWritable QueryGroupMetadata Signed-off-by: Kaushal Kumar <[email protected]> * structure resourceLimits into an object Signed-off-by: Kaushal Kumar <[email protected]> * add QueryGroup.toXContent test case Signed-off-by: Kaushal Kumar <[email protected]> * fix precommit errors Signed-off-by: Kaushal Kumar <[email protected]> * fix precommit errors Signed-off-by: Kaushal Kumar <[email protected]> * fix assemble errors Signed-off-by: Kaushal Kumar <[email protected]> * fix checkstyle errors Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]> * add min supported version in query group metadata Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]>

…) (opensearch-project#14691) (cherry picked from commit acc4631) Signed-off-by: Chenyang Ji <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…search-project#14701) (cherry picked from commit 5ef41cf) Signed-off-by: Zelin Hao <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…arch-project#14700) (cherry picked from commit a04cf24) Signed-off-by: Andriy Redko <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…pensearch-project#14695) (cherry picked from commit b8dc46d) Signed-off-by: Andriy Redko <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…arch-project#14702) (cherry picked from commit c4d960f) Signed-off-by: Andriy Redko <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

… calculation inside LocalShardBalancer (opensearch-project#14675) (opensearch-project#14689) (cherry picked from commit 6d0484a) Signed-off-by: RS146BIJAY <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

… for transient settings (opensearch-project#14476) (opensearch-project#14705) (cherry picked from commit b068355) Signed-off-by: Shivansh Arora <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…pensearch-project#14707) (cherry picked from commit 605543b) Signed-off-by: Lukáš Vlček <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…pinned timestamp setting (opensearch-project#15457) (opensearch-project#15553) (cherry picked from commit 30ed15d) Signed-off-by: Sachin Kale <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Sachin Kale <[email protected]>

…arch-project#15511) (opensearch-project#15540) * Extract SegmentReplicator class from SegmentReplicationTargetService. This change separates code that initiates replication from the target service component in prepartion for implementing a task to initate replication events on an interval. * Pass timeout value to Replicator instead of fetching from shard --------- (cherry picked from commit 2224d48) Signed-off-by: Marc Handalian <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Create Index using context (opensearch-project#15290) Signed-off-by: Mohit Godwani <[email protected]>

…ch-project#15353) (opensearch-project#15566) --------- Signed-off-by: Lakshya Taragi <[email protected]> Signed-off-by: Sachin Kale <[email protected]> Co-authored-by: Lakshya Taragi <[email protected]>

…ctor (opensearch-project#15416) (opensearch-project#15567) (cherry picked from commit ef47252) Signed-off-by: Sachin Kale <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…#15574) --------- (cherry picked from commit 6bae704) Signed-off-by: Sarthak Aggarwal <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

) (opensearch-project#15570) --------- Signed-off-by: Arpit Bandejiya <[email protected]> (cherry picked from commit b54e867)

…h-project#15526) (opensearch-project#15587) --------- (cherry picked from commit cfcfe21) Signed-off-by: Sachin Kale <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Sachin Kale <[email protected]>

…ject#15465) (opensearch-project#15589) * Add limit on number of processors in Ingest pipelines (cherry picked from commit 41ba00a) Signed-off-by: Rai <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…edIndex (opensearch-project#15598) (opensearch-project#15605) (cherry picked from commit 022acba) Signed-off-by: Sachin Kale <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Sachin Kale <[email protected]>

…t#13966) (opensearch-project#15594) * Support cancellation for admin apis (opensearch-project#13966) * Support cancellation for admin apis - add implementation for _cat/shards Signed-off-by: Somesh Gupta <[email protected]> (cherry picked from commit 9f81479)

…t#15100) (opensearch-project#15582) Simplify diff calculation logic for remote routing table Signed-off-by: Bukhtawar Khan <[email protected]>

…bugEnabled (opensearch-project#15204) (opensearch-project#15597) * Fix test MasterServiceTests.testClusterStateUpdateLoggingWithDebugEnabled (cherry picked from commit b23c9de) Signed-off-by: Sumit Bansal <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…rch-project#15509) (opensearch-project#15591) (cherry picked from commit bcd09ab) Signed-off-by: Sooraj Sinha <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…ct#15569) * [SnapshotV2] Support centralize snapshot creation (opensearch-project#15124) * Initial Commit to support centralize snapshot creation and implicit locking mechanism Signed-off-by: Anshu Agarwal <[email protected]> * Fix deserilization error Signed-off-by: Anshu Agarwal <[email protected]> * Fix gradle spotless check Signed-off-by: Anshu Agarwal <[email protected]> * Fix listener Signed-off-by: Anshu Agarwal <[email protected]> * Fix test Signed-off-by: Anshu Agarwal <[email protected]> * Fix snapshot generation Signed-off-by: Anshu Agarwal <[email protected]> * Modify cluster setting name Signed-off-by: Anshu Agarwal <[email protected]> * Add more tests Signed-off-by: Anshu Agarwal <[email protected]> * Uncomment pin timestamp code Signed-off-by: Anshu Agarwal <[email protected]> * Modify log messages Signed-off-by: Anshu Agarwal <[email protected]> * Add spotless check failure fix Signed-off-by: Anshu Agarwal <[email protected]> * Fix completion listener for snapshot v2 Signed-off-by: Anshu Agarwal <[email protected]> * Elevate cluster state update priority for repository metadata update task Signed-off-by: Anshu Agarwal <[email protected]> * Add more integ tests Signed-off-by: Anshu Agarwal <[email protected]> * Add priority as IMMEDIATE for cluster state repo update task only for v2 snapshots Signed-off-by: Anshu Agarwal <[email protected]> * Fix build error Signed-off-by: Anshu Agarwal <[email protected]> * Fix spotless error Signed-off-by: Anshu Agarwal <[email protected]> * Add repository setting for snapshot v2 Signed-off-by: Anshu Agarwal <[email protected]> * Address review comments Signed-off-by: Anshu Agarwal <[email protected]> * Add integ test to verify snapshot creation if shallow copy repo setting is disabled Signed-off-by: Anshu Agarwal <[email protected]> * Fix spotless vilation error Signed-off-by: Anshu Agarwal <[email protected]> * Address review comment Signed-off-by: Anshu Agarwal <[email protected]> * Address review comments Signed-off-by: Anshu Agarwal <[email protected]> * Add min version check for backward compatibility Signed-off-by: Anshu Agarwal <[email protected]> * address review comments Signed-off-by: Anshu Agarwal <[email protected]> * add integ test for master failover scenario Signed-off-by: Anshu Agarwal <[email protected]> * Add more integ tests Signed-off-by: Anshu Agarwal <[email protected]> * refactor code Signed-off-by: Anshu Agarwal <[email protected]> * add changelog Signed-off-by: Anshu Agarwal <[email protected]> * Add pinned timestamp setting in integ tests Signed-off-by: Anshu Agarwal <[email protected]> --------- Signed-off-by: Anshu Agarwal <[email protected]> Signed-off-by: Anshu Agarwal <[email protected]> Co-authored-by: Anshu Agarwal <[email protected]> (cherry picked from commit 23cba28) Signed-off-by: Anshu Agarwal <[email protected]> * Fix spotless check failure Signed-off-by: Anshu Agarwal <[email protected]> * fix :server:japicmp failure Signed-off-by: Anshu Agarwal <[email protected]> * backort PR#15602 Signed-off-by: Anshu Agarwal <[email protected]> --------- Signed-off-by: Anshu Agarwal <[email protected]> Signed-off-by: Anshu Agarwal <[email protected]> Co-authored-by: Anshu Agarwal <[email protected]>

…n is false (opensearch-project#15615) Signed-off-by: Anshu Agarwal <[email protected]>

…nsearch-project#15618) (cherry picked from commit 12f6493) Signed-off-by: Sarthak Aggarwal <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…it is required (opensearch-project#15617) Signed-off-by: RS146BIJAY <[email protected]>

…project#15616) (opensearch-project#15619) Signed-off-by: Anshu Agarwal <[email protected]> Co-authored-by: Anshu Agarwal <[email protected]> (cherry picked from commit c62626d)

…om (opensearch-project#15010) (opensearch-project#15628) local to remote pool for hot to warm tiering Signed-off-by: Neetika Singhal <[email protected]> (cherry picked from commit c19cf88)

…t#15626) (opensearch-project#15629) (cherry picked from commit bc02f90) Signed-off-by: Sarat Vemulapalli <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…pensearch-project#15630)

…#15579) (opensearch-project#15623) * Abstract out RemoteFsTranslog with pinned timestamps (cherry picked from commit deeb2de) Signed-off-by: Sachin Kale <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

…ct#15624 to 2.x (opensearch-project#15595) * [SnapshotV2] Snapshot Status API changes (opensearch-project#15409) --------- Signed-off-by: Lakshya Taragi <[email protected]> (cherry picked from commit 925f41b) * Remove breaking changes from opensearch-project#15409 (opensearch-project#15624) Signed-off-by: Lakshya Taragi <[email protected]> (cherry picked from commit a60b668)

…oject#15533) (opensearch-project#15610) --------- Signed-off-by: Bharathwaj G <[email protected]>

* [ClusterManagerTaskThrottler Improvements] : Add shallow check in ClusterManagerTaskThrottler to fail fast before computeIfPresent to avoid lock when queue is full Signed-off-by: Sumit Bansal <[email protected]> (cherry picked from commit 17b5f98)

github-actions · 2024-09-04T08:15:55Z

❕ Gradle check result for 9517328: UNSTABLE

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

codecov · 2024-09-04T08:17:01Z

Codecov Report

Attention: Patch coverage is 46.32546% with 409 lines in your changes missing coverage. Please review.

Project coverage is 71.74%. Comparing base (58467f6) to head (9517328).
Report is 3272 commits behind head on main.

Files with missing lines	Patch %	Lines
...rc/main/java/org/opensearch/client/RestClient.java	27.08%	104 Missing and 1 partial ⚠️
...va/org/opensearch/client/ReactiveDataProducer.java	0.00%	63 Missing ⚠️
...va/org/opensearch/client/ReactiveDataConsumer.java	0.00%	53 Missing ⚠️
...org/opensearch/client/ReactiveRequestProducer.java	0.00%	49 Missing ⚠️
...ensearch/gradle/test/rest/RestResourcesPlugin.java	0.00%	18 Missing ⚠️
.../java/org/opensearch/client/StreamingResponse.java	0.00%	17 Missing ⚠️
...rg/opensearch/client/ReactiveResponseConsumer.java	0.00%	15 Missing ⚠️
...n/java/org/opensearch/client/StreamingRequest.java	43.47%	12 Missing and 1 partial ⚠️
...n/annotation/processor/ApiAnnotationProcessor.java	58.06%	7 Missing and 6 partials ⚠️
.../search/pipeline/common/SortResponseProcessor.java	81.96%	5 Missing and 6 partials ⚠️
... and 15 more

Additional details and impacted files

@@             Coverage Diff              @@
##               main   #15646      +/-   ##
============================================
+ Coverage     71.40%   71.74%   +0.33%     
- Complexity    62313    64134    +1821     
============================================
  Files          5102     5249     +147     
  Lines        293175   299689    +6514     
  Branches      42717    43642     +925     
============================================
+ Hits         209345   215007    +5662     
- Misses        66227    66731     +504     
- Partials      17603    17951     +348

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

reta and others added 30 commits June 27, 2024 14:02

Allow @internalapi annotation on classes not meant to be constructed …

2caa7db

…outside of the OpenSearch core (opensearch-project#14575) (opensearch-project#14579) Signed-off-by: Andriy Redko <[email protected]> (cherry picked from commit 391dee2)

opensearch-trigger-bot bot and others added 26 commits August 31, 2024 21:43

[Backport-2.x] Create Index using context (opensearch-project#15530)

2a2fcbd

* Create Index using context (opensearch-project#15290) Signed-off-by: Mohit Godwani <[email protected]>

Populate RecoveryState details for shallow snapshot restore (opensear…

ed675f8

…ch-project#15353) (opensearch-project#15566) --------- Signed-off-by: Lakshya Taragi <[email protected]> Signed-off-by: Sachin Kale <[email protected]> Co-authored-by: Lakshya Taragi <[email protected]>

[Remote Publication] Add remote download stats (opensearch-project#15291

834b7c1

) (opensearch-project#15570) --------- Signed-off-by: Arpit Bandejiya <[email protected]> (cherry picked from commit b54e867)

Simplify diff calculation for remote routing table (opensearch-projec…

50f411e

…t#15100) (opensearch-project#15582) Simplify diff calculation logic for remote routing table Signed-off-by: Bukhtawar Khan <[email protected]>

[Backport] Modify create snapshot v2 response when wait_for_completio…

89a7d75

…n is false (opensearch-project#15615) Signed-off-by: Anshu Agarwal <[email protected]>

Serializing node attribute in discoveryNode only in scenarioes where …

67eceaa

…it is required (opensearch-project#15617) Signed-off-by: RS146BIJAY <[email protected]>

SnapshotInfo pinned timestamp version change to V_2_17_0 (opensearch-…

9ba4c53

…project#15616) (opensearch-project#15619) Signed-off-by: Anshu Agarwal <[email protected]> Co-authored-by: Anshu Agarwal <[email protected]> (cherry picked from commit c62626d)

Add canRemain method to TargetPoolAllocationDecider to move shards fr…

c760c3a

…om (opensearch-project#15010) (opensearch-project#15628) local to remote pool for hot to warm tiering Signed-off-by: Neetika Singhal <[email protected]> (cherry picked from commit c19cf88)

pluggable deciders for concurrent search (opensearch-project#15363) (o…

39aa3e4

…pensearch-project#15630)

[Backport 2.x] [Star tree] Star tree index validations (opensearch-pr…

5875393

…oject#15533) (opensearch-project#15610) --------- Signed-off-by: Bharathwaj G <[email protected]>

sumitasr closed this Sep 4, 2024

opensearch-ci-bot mentioned this pull request Sep 11, 2024

[AUTOCUT] Gradle Check Flaky Test Report for RecoveryFromGatewayIT #14304

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Backport/backport 15508 to 2.x #15646

Backport/backport 15508 to 2.x #15646

sumitasr commented Sep 4, 2024

github-actions bot commented Sep 4, 2024

codecov bot commented Sep 4, 2024

Backport/backport 15508 to 2.x #15646

Backport/backport 15508 to 2.x #15646

Conversation

sumitasr commented Sep 4, 2024

Description

Related Issues

Check List

github-actions bot commented Sep 4, 2024

codecov bot commented Sep 4, 2024

Codecov Report