[Backport 2.x] Moving zstd out of sanbox and enabling index setting

[sarthakaggarwal97]

Description

Backporting #7908 to 2.x

Related Issues

Resolves #7805

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[sarthakaggarwal97]

@dblock @reta @backslasht created a backport PR for zstd

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testReplicaHasDiffFilesThanPrimary
      1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPressureServiceStats
      1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPressureServiceStats
      1 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocation

• URL: https://build.ci.opensearch.org/job/gradle-check/18645/
• CommitID: a2e4af0
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18646/
• CommitID: 7bb68db
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18684/
• CommitID: 7bb68db
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18908/
• CommitID: fdde82b
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18912/
• CommitID: bae4c4e
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18917/
• CommitID: 08388ca
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18925/
• CommitID: 37ca427
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18923/
• CommitID: fe7323d
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/19003/
• CommitID: 0eea19c

[codecov]

Codecov Report

Merging #8336 (0eea19c) into 2.x (2e5195b) will decrease coverage by 0.06%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##                2.x    #8336      +/-   ##
============================================
- Coverage     70.66%   70.61%   -0.06%     
+ Complexity    56948    56924      -24     
============================================
  Files          4718     4717       -1     
  Lines        269771   269782      +11     
  Branches      39887    39887              
============================================
- Hits         190637   190506     -131     
- Misses        62765    62925     +160     
+ Partials      16369    16351      -18     

Impacted Files	Coverage Δ
.../index/codec/customcodecs/ZstdCompressionMode.java	86.36% <ø> (ø)
.../codec/customcodecs/ZstdNoDictCompressionMode.java	79.45% <ø> (ø)
...java/org/opensearch/index/engine/EngineConfig.java	98.50% <ø> (ø)
.../java/org/opensearch/index/codec/CodecService.java	100.00% <100.00%> (+11.11%)	⬆️
.../index/codec/customcodecs/Lucene95CustomCodec.java	76.92% <100.00%> (ø)
...customcodecs/Lucene95CustomStoredFieldsFormat.java	72.00% <100.00%> (ø)
...opensearch/index/codec/customcodecs/ZstdCodec.java	100.00% <100.00%> (ø)
...arch/index/codec/customcodecs/ZstdNoDictCodec.java	100.00% <100.00%> (ø)

... and 457 files with indirect coverage changes