-
Notifications
You must be signed in to change notification settings - Fork 503
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add a note about zstd incompatibility with k-NN and security analytics #5014
Conversation
…s plugins Signed-off-by: Fanit Kolchina <[email protected]>
@sarthakaggarwal97 Could you review this PR please? |
Signed-off-by: Fanit Kolchina <[email protected]>
LGTM! thanks @kolchfa-aws for taking this up! |
_im-plugin/index-codecs.md
Outdated
@@ -24,6 +24,9 @@ It may be challenging to change the codec setting of an existing index (see [Cha | |||
* `zstd` (OpenSearch 2.9 and later) -- This codec provides significant compression comparable to the `best_compression` codec with reasonable CPU usage and improved indexing and search performance compared to the `default` codec. | |||
* `zstd_no_dict` (OpenSearch 2.9 and later) -- This codec is similar to `zstd` but excludes the dictionary compression feature. It provides faster indexing and search operations compared to `zstd` at the expense of a slightly larger index size. | |||
|
|||
As of OpenSearch 2.10, the `zstd` and `zstd_no_dict` codecs are not compatible with the [k-NN]({{site.url}}{{site.baseurl}}/search-plugins/knn/index/) and [Security Analytics]({{site.url}}{{site.baseurl}}/security-analytics/index/) plugins. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we rephrase it to
As of OpenSearch 2.10, the
zstd
andzstd_no_dict
compression codecs can not be used for k-NN and Security Analytics indices.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor comment, zstd and zstd_no_dict codecs will not be usable for the knn/ security-analytics indices. They can still be installed together
Signed-off-by: kolchfa-aws <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks @kolchfa-aws , looks good!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM with one minor change.
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: kolchfa-aws <[email protected]>
opensearch-project#5014) * Add a note about zstd incompatibility with k-NN and security analytics plugins Signed-off-by: Fanit Kolchina <[email protected]> * Capitalization Signed-off-by: Fanit Kolchina <[email protected]> * Update _im-plugin/index-codecs.md Signed-off-by: kolchfa-aws <[email protected]> * Update _im-plugin/index-codecs.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: kolchfa-aws <[email protected]> --------- Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>
#5014) * Add a note about zstd incompatibility with k-NN and security analytics plugins Signed-off-by: Fanit Kolchina <[email protected]> * Capitalization Signed-off-by: Fanit Kolchina <[email protected]> * Update _im-plugin/index-codecs.md Signed-off-by: kolchfa-aws <[email protected]> * Update _im-plugin/index-codecs.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: kolchfa-aws <[email protected]> --------- Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>
Fixes #5002
Checklist
For more information on following Developer Certificate of Origin and signing off your commits, please check here.