Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backport/backport 6788 to 2.x #8296

Conversation

harishbhakuni
Copy link
Contributor

@harishbhakuni harishbhakuni commented Jun 27, 2023

Description

Backporting Changes of PR #6788 to 2.x branch. auto backport is failing due to version checks using 3.0 version. updated changes with 2.9.

Related Issues

#6788

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

gashutos and others added 30 commits April 26, 2023 09:52
…gment read (opensearch-project#7244)

This commit changes the EngineConfig for timeseries indexes only (e.g., indexes that use 
the @timestamp metadata field) so that a descending LeafSorter comparator is used to 
visit segments in order of most newest to oldest. For the more infrequent case that a user 
chooses to sort query results by ASC time, this would cause a search regression so the 
ContextIndexSearcher is updated to inspect the sort order from the search request and 
reverse the comparator so segments are visited in ascending order. LeafSorter behavior 
for non-timeseries indexes is left the same. 

Signed-off-by: gashutos <[email protected]>
Signed-off-by: Chaitanya Gohel <[email protected]>
…roject#7306)

Refactors usage of ImmutableOpenMap in IndexMetadata to java.util.Map.
This continues the removal of the HPPC dependency in core.

Signed-off-by: Nicholas Walter Knize <[email protected]>
…nsearch-project#7309)

Refactors all remaining usage of HPPC backed ImmutableOpenMap to
j.u.Map. This is the last usage of the class so ImmutableOpenMap is
completely removed in favor of java maps.

Signed-off-by: Nicholas Walter Knize <[email protected]>
* Remove builder instance from TextFieldMapper
* Add test coverage for mapping params serialization

Signed-off-by: Sooraj Sinha <[email protected]>
…pensearch-project#7230)

* Replaces ZipInputStream with ZipFile to fix ZipSlip vulnerability

More details about the vulenrability can be found on https://github.com/snyk/zip-slip-vulnerability

Signed-off-by: Darshit Chanpura <[email protected]>

* Adds a CHANGELOG entry

Signed-off-by: Darshit Chanpura <[email protected]>

* Changes the base package for ZipFile to avoid forbiddenApisError

Signed-off-by: Darshit Chanpura <[email protected]>

* Updates SHAs

Signed-off-by: Darshit Chanpura <[email protected]>

* Adds LICENSE and NOTICE files for commons-compress package

Signed-off-by: Darshit Chanpura <[email protected]>

* Updates thirdParty ignoreMissingClasses list

Signed-off-by: Darshit Chanpura <[email protected]>

* Closes input stream

Signed-off-by: Darshit Chanpura <[email protected]>

* Fixes NoSuchFileException when reading files

Signed-off-by: Darshit Chanpura <[email protected]>

* Fixes spotless errors

Signed-off-by: Darshit Chanpura <[email protected]>

* Fixes CHANGELOG.md

Signed-off-by: Darshit Chanpura <[email protected]>

* Addresses PR comments

Signed-off-by: Darshit Chanpura <[email protected]>

---------

Signed-off-by: Darshit Chanpura <[email protected]>
GitHub requires a magic word to properly link a PR to an issue so that
the issue is automatically closed when the PR is merged.

Signed-off-by: Andrew Ross <[email protected]>
…6866)

* Add connectToNodeAsExtension in TransportService

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Update java docstrings

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
…ect#7322)

* moved flat object from changed to added b/c it's new and added a little more description

Signed-off-by: Mark Cohen <[email protected]>

* switch flat object line to the issue instead of the PR

Signed-off-by: Mark Cohen <[email protected]>

---------

Signed-off-by: Mark Cohen <[email protected]>
opensearch-project#7311)

* Bump com.netflix.nebula:nebula-publishing-plugin from 20.2.0 to 20.3.0

Bumps [com.netflix.nebula:nebula-publishing-plugin](https://github.com/nebula-plugins/nebula-publishing-plugin) from 20.2.0 to 20.3.0.
- [Release notes](https://github.com/nebula-plugins/nebula-publishing-plugin/releases)
- [Changelog](https://github.com/nebula-plugins/nebula-publishing-plugin/blob/main/CHANGELOG.md)
- [Commits](nebula-plugins/nebula-publishing-plugin@v20.2.0...v20.3.0)

---
updated-dependencies:
- dependency-name: com.netflix.nebula:nebula-publishing-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
…ribution/packages (opensearch-project#7310)

* Bump com.netflix.nebula.ospackage-base in /distribution/packages

Bumps com.netflix.nebula.ospackage-base from 11.2.0 to 11.3.0.

---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage-base
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
…opensearch-project#7328)

* [Refactor] Version and LegacyESVersion to core lib

Refactors the Version and LegacyESVersion classes from the server module
to the core library. All gradle build scripts and dependencies are
updated. This commit serves as a foundation for refactoring all
OpenSearch base classes from the server module into appropriate
libraries to decouple core search logic from the cluster model so
it can be reused in serverless and cloud native environments.

Signed-off-by: Nicholas Walter Knize <[email protected]>

* fix javadoc

Signed-off-by: Nicholas Walter Knize <[email protected]>

---------

Signed-off-by: Nicholas Walter Knize <[email protected]>
opensearch-project#7340)

* Bump gradle.plugin.com.github.johnrengelman:shadow from 7.1.2 to 8.0.0

Bumps gradle.plugin.com.github.johnrengelman:shadow from 7.1.2 to 8.0.0.

---
updated-dependencies:
- dependency-name: gradle.plugin.com.github.johnrengelman:shadow
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
* Identity and access control for OpenSearch

Adding a new service and plugin interface that provides identity and access control inside of OpenSearch. This is the founding building block, see more high level thoughts here on our recent blog. https://opensearch.org/blog/Introducing-Identity/

The new extension point, IdentityPlugin, is added with IdentityService handling that plugin interface. IdentityService authenticates users and enables access control systems. Adding HTTP basic authentication in the RestController the default NoopIdentityPlugin changes no behavior.

Signed-off-by: Stephen Crawford <[email protected]>
Signed-off-by: Peter Nied <[email protected]>
Co-authored-by: Peter Nied <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
…pensearch-project#7302)

Add cross version support for register Rest Actions for extensions

Signed-off-by: Sarat Vemulapalli <[email protected]>
…7367)

* Updated developer guide for adding dependencies.

Signed-off-by: dblock <[email protected]>

* Update DEVELOPER_GUIDE.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
)

Signed-off-by: GitHub <[email protected]>
Co-authored-by: opensearch-ci-bot <[email protected]>
(cherry picked from commit 5a5c269)

Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
* Cleanup interfaces around ExtensionManager

ExtensionsManager has a whole lot of functionality that shouldn't be
exposed to external classes, marked much of this package protected for a
cleaner interface.  Then updated the Noop version to override all public
functions to remove extranious feature flag checks.

Note; I didn't go so far to remove all getters/setters that were unused
but that could be a good follow up in the future.

Signed-off-by: Peter Nied <[email protected]>
* Add extension functionality to OpenSearch gradle plugin

Signed-off-by: Ryan Bogan <[email protected]>

* Modify gradle plugin to run both extensions and plugins

Signed-off-by: Ryan Bogan <[email protected]>

* Fix spotless

Signed-off-by: Ryan Bogan <[email protected]>

* Change feature flag initialization

Signed-off-by: Ryan Bogan <[email protected]>

* Address PR comments

Signed-off-by: Ryan Bogan <[email protected]>

* Change error method and remove unnecessary feature flag setting

Signed-off-by: Ryan Bogan <[email protected]>

---------

Signed-off-by: Ryan Bogan <[email protected]>
…ctions (opensearch-project#7403)

* Adding cross version support for RegisterTransportActions for extensions

Signed-off-by: Sarat Vemulapalli <[email protected]>
nknize and others added 5 commits June 26, 2023 20:07
* [Upgrade] Lucene 9.7.0 release

Upgrades to the official 9.7.0 release of lucene

Signed-off-by: Nicholas Walter Knize <[email protected]>

* update changelog

Signed-off-by: Nicholas Walter Knize <[email protected]>

---------

Signed-off-by: Nicholas Walter Knize <[email protected]>
…ore Interoperability (opensearch-project#6788)

* [Snapshot Interop] Add Changes in Restore Snapshot Flow for remote store interoperability.
---------

Signed-off-by: Harish Bhakuni <[email protected]>
Co-authored-by: Harish Bhakuni <[email protected]>
(cherry picked from commit 317dd03)
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.