Skip to content

Commit

Permalink
Merge branch 'opensearch-project:main' into replica-lagging-fail
Browse files Browse the repository at this point in the history
  • Loading branch information
Rishikesh1159 authored Apr 5, 2023
2 parents 1be88b7 + c334bbd commit 11d82d1
Show file tree
Hide file tree
Showing 120 changed files with 1,585 additions and 700 deletions.
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,7 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
- Fix 'org.apache.hc.core5.http.ParseException: Invalid protocol version' under JDK 16+ ([#4827](https://github.com/opensearch-project/OpenSearch/pull/4827))
- Fix compression support for h2c protocol ([#4944](https://github.com/opensearch-project/OpenSearch/pull/4944))
- Support OpenSSL Provider with default Netty allocator ([#5460](https://github.com/opensearch-project/OpenSearch/pull/5460))
- Avoid negative memory result in IndicesQueryCache stats calculation ([#6917](https://github.com/opensearch-project/OpenSearch/pull/6917))

### Security

Expand All @@ -88,6 +89,7 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
- Enable sort optimization for all NumericTypes ([#6464](https://github.com/opensearch-project/OpenSearch/pull/6464)
- Remove 'cluster_manager' role attachment when using 'node.master' deprecated setting ([#6331](https://github.com/opensearch-project/OpenSearch/pull/6331))
- Add new cluster settings to ignore weighted round-robin routing and fallback to default behaviour. ([#6834](https://github.com/opensearch-project/OpenSearch/pull/6834))
- Add experimental support for ZSTD compression. ([#3577](https://github.com/opensearch-project/OpenSearch/pull/3577))

### Dependencies
- Bump `org.apache.logging.log4j:log4j-core` from 2.18.0 to 2.20.0 ([#6490](https://github.com/opensearch-project/OpenSearch/pull/6490))
Expand All @@ -103,6 +105,8 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
- Bump `net.minidev:json-smart` from 2.4.7 to 2.4.10
- Bump `org.apache.maven:maven-model` from 3.6.2 to 3.9.1
- Bump `org.codehaus.jettison:jettison` from 1.5.3 to 1.5.4 ([#6878](https://github.com/opensearch-project/OpenSearch/pull/6878))
- Add `com.github.luben:zstd-jni:1.5.4-1` ([#3577](https://github.com/opensearch-project/OpenSearch/pull/3577))
- Bump: Netty from 4.1.90.Final to 4.1.91.Final , ASM 9.4 to ASM 9.5, ByteBuddy 1.14.2 to 1.14.3 ([#6981](https://github.com/opensearch-project/OpenSearch/pull/6981))

### Changed
- Require MediaType in Strings.toString API ([#6009](https://github.com/opensearch-project/OpenSearch/pull/6009))
Expand Down
6 changes: 3 additions & 3 deletions buildSrc/version.properties
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ supercsv = 2.4.0
# Update to 2.17.2+ is breaking OpenSearchJsonLayout (see https://issues.apache.org/jira/browse/LOG4J2-3562)
log4j = 2.17.1
slf4j = 1.7.36
asm = 9.4
asm = 9.5
jettison = 1.5.4
woodstox = 6.4.0
kotlin = 1.7.10
Expand All @@ -26,7 +26,7 @@ guava = 31.1-jre
# when updating the JNA version, also update the version in buildSrc/build.gradle
jna = 5.5.0

netty = 4.1.90.Final
netty = 4.1.91.Final
joda = 2.12.2

# client dependencies
Expand All @@ -51,7 +51,7 @@ junit = 4.13.2
hamcrest = 2.1
mockito = 5.2.0
objenesis = 3.2
bytebuddy = 1.14.2
bytebuddy = 1.14.3

# benchmark dependencies
jmh = 1.35
1 change: 0 additions & 1 deletion modules/lang-expression/licenses/asm-9.4.jar.sha1

This file was deleted.

1 change: 1 addition & 0 deletions modules/lang-expression/licenses/asm-9.5.jar.sha1
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
dc6ea1875f4d64fbc85e1691c95b96a3d8569c90
1 change: 0 additions & 1 deletion modules/lang-expression/licenses/asm-commons-9.4.jar.sha1

This file was deleted.

1 change: 1 addition & 0 deletions modules/lang-expression/licenses/asm-commons-9.5.jar.sha1
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
19ab5b5800a3910d30d3a3e64fdb00fd0cb42de0
1 change: 0 additions & 1 deletion modules/lang-expression/licenses/asm-tree-9.4.jar.sha1

This file was deleted.

1 change: 1 addition & 0 deletions modules/lang-expression/licenses/asm-tree-9.5.jar.sha1
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
fd33c8b6373abaa675be407082fdfda35021254a
1 change: 0 additions & 1 deletion modules/lang-painless/licenses/asm-9.4.jar.sha1

This file was deleted.

1 change: 1 addition & 0 deletions modules/lang-painless/licenses/asm-9.5.jar.sha1
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
dc6ea1875f4d64fbc85e1691c95b96a3d8569c90
1 change: 0 additions & 1 deletion modules/lang-painless/licenses/asm-analysis-9.4.jar.sha1

This file was deleted.

1 change: 1 addition & 0 deletions modules/lang-painless/licenses/asm-analysis-9.5.jar.sha1
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
490bacc77de7cbc0be1a30bb3471072d705be4a4
1 change: 0 additions & 1 deletion modules/lang-painless/licenses/asm-commons-9.4.jar.sha1

This file was deleted.

1 change: 1 addition & 0 deletions modules/lang-painless/licenses/asm-commons-9.5.jar.sha1
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
19ab5b5800a3910d30d3a3e64fdb00fd0cb42de0
1 change: 0 additions & 1 deletion modules/lang-painless/licenses/asm-tree-9.4.jar.sha1

This file was deleted.

1 change: 1 addition & 0 deletions modules/lang-painless/licenses/asm-tree-9.5.jar.sha1
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
fd33c8b6373abaa675be407082fdfda35021254a
1 change: 0 additions & 1 deletion modules/lang-painless/licenses/asm-util-9.4.jar.sha1

This file was deleted.

1 change: 1 addition & 0 deletions modules/lang-painless/licenses/asm-util-9.5.jar.sha1
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
64b5a1fc8c1b15ed2efd6a063e976bc8d3dc5ffe
7 changes: 6 additions & 1 deletion modules/transport-netty4/build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -253,6 +253,11 @@ thirdPartyAudit {
'io.netty.util.internal.shaded.org.jctools.queues.MpscArrayQueueProducerLimitField',
'io.netty.util.internal.shaded.org.jctools.util.UnsafeAccess',
'io.netty.util.internal.shaded.org.jctools.util.UnsafeRefArrayAccess',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator'
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$1',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$2',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$3',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$4',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$5'
)
}

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
d8f180291c3501e931968ca7e40ae0323c4eacee

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
3044b8e325e33f72c96ac1ea51dda85bef090cc0

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
4519d2ff470941f0086214b19c9acf992868112f

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
4ee7027e1653c6ee3f843191e0d932f29e8e14e1

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
93e5056462a242718e7689d81180d125c79d7723

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
444cf41e4fe28c47ffebba5e77b9458a12f938a1

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
04725d117d4b71ef0e743aa79062489b45472b26

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
c2f6bd7143194ca842b535546a405c06aa993934

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
80990b5885b8b67be096d7090cba18f05c67120e

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
2c0242c69eee44ee559d02c564dbceee8bf0a5c7

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
4ee7027e1653c6ee3f843191e0d932f29e8e14e1

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
8f0a52677da411a8ab762c426d723c7f54471504

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
2e3e57eae1a61e4e5f558e39619186fec6c424d3

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
e1567967f5a85a469b10b7394e3e2b90ea5c0b12

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
80990b5885b8b67be096d7090cba18f05c67120e

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
d96d417b6c6b4a786d54418e09593c4b2292f437
7 changes: 6 additions & 1 deletion plugins/transport-nio/build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -193,6 +193,11 @@ thirdPartyAudit {
'io.netty.util.internal.shaded.org.jctools.util.UnsafeAccess',
'io.netty.util.internal.shaded.org.jctools.util.UnsafeRefArrayAccess',

'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator'
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$1',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$2',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$3',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$4',
'io.netty.handler.ssl.util.OpenJdkSelfSignedCertGenerator$5'
)
}

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
d8f180291c3501e931968ca7e40ae0323c4eacee

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
3044b8e325e33f72c96ac1ea51dda85bef090cc0

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
4519d2ff470941f0086214b19c9acf992868112f

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
93e5056462a242718e7689d81180d125c79d7723

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
444cf41e4fe28c47ffebba5e77b9458a12f938a1

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
04725d117d4b71ef0e743aa79062489b45472b26

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
c2f6bd7143194ca842b535546a405c06aa993934
28 changes: 28 additions & 0 deletions sandbox/modules/custom-codecs/build.gradle
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
/*
* SPDX-License-Identifier: Apache-2.0
*
* The OpenSearch Contributors require contributions made to
* this file be licensed under the Apache-2.0 license or a
* compatible open source license.
*
* Modifications Copyright OpenSearch Contributors. See
* GitHub history for details.
*/

apply plugin: 'opensearch.opensearchplugin'
apply plugin: 'opensearch.yaml-rest-test'

opensearchplugin {
name 'custom-codecs'
description 'A plugin that implements custom compression codecs.'
classname 'org.opensearch.index.codec.customcodecs.CustomCodecPlugin'
licenseFile rootProject.file('licenses/APACHE-LICENSE-2.0.txt')
noticeFile rootProject.file('NOTICE.txt')
}

dependencies {
api "com.github.luben:zstd-jni:1.5.4-1"
}

yamlRestTest.enabled = false;
testingConventions.enabled = false;
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
291ccaacc039e41932de877303edb6af98a91c24
29 changes: 29 additions & 0 deletions sandbox/modules/custom-codecs/licenses/zstd-jni-LICENSE.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
-----------------------------------------------------------------------------
** Beginning of "BSD License" text. **

Zstd-jni: JNI bindings to Zstd Library

Copyright (c) 2015-present, Luben Karavelov/ All rights reserved.

BSD License

Redistribution and use in source and binary forms, with or without modification,
are permitted provided that the following conditions are met:

1. Redistributions of source code must retain the above copyright notice, this
list of conditions and the following disclaimer.

2. Redistributions in binary form must reproduce the above copyright notice, this
list of conditions and the following disclaimer in the documentation and/or
other materials provided with the distribution.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR
ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON
ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
1 change: 1 addition & 0 deletions sandbox/modules/custom-codecs/licenses/zstd-jni-NOTICE.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
The code for the JNI bindings to Zstd library was originally authored by Luben Karavelov
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
/*
* SPDX-License-Identifier: Apache-2.0
*
* The OpenSearch Contributors require contributions made to
* this file be licensed under the Apache-2.0 license or a
* compatible open source license.
*/

package org.opensearch.index.codec.customcodecs;

import org.opensearch.plugins.Plugin;
import org.opensearch.plugins.EnginePlugin;
import org.opensearch.index.codec.CodecServiceFactory;
import org.opensearch.index.IndexSettings;

import java.util.Optional;

/**
* A plugin that implements custom codecs. Supports these codecs:
* <ul>
* <li>ZSTD
* <li>ZSTDNODICT
* </ul>
*
* @opensearch.internal
*/
public final class CustomCodecPlugin extends Plugin implements EnginePlugin {

/** Creates a new instance */
public CustomCodecPlugin() {}

/**
* @param indexSettings is the default indexSettings
* @return the engine factory
*/
@Override
public Optional<CodecServiceFactory> getCustomCodecServiceFactory(final IndexSettings indexSettings) {
return Optional.of(new CustomCodecServiceFactory());
}
}
Loading

0 comments on commit 11d82d1

Please sign in to comment.