[Segment Replication] Add lucene codec tests

[dreamer-89]

Description

This change adds integration tests for lucene codecs.

1. testWithOlderCodecs. Validate that segment replication works with older lucene codecs. Verified with string matching checks, this test fails. Tested this on branch codec-string-match
2. testWithDifferentCompressionModes. Validates that segment replication works with different codec compression modes.

Related Issues

Resolves #7781
#3881

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/16780/
• CommitID: d78745a
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[dreamer-89]

The PR still blocked on usage of openStream() method call and fails due :server:forbiddenApisInternalClusterTest task. It fails in below line

ZipInputStream zip = new ZipInputStream(Codec.class.getProtectionDomain().getCodeSource().getLocation().openStream());

Gradle failure

> Task :server:forbiddenApisInternalClusterTest FAILED
Forbidden method invocation: java.net.URL#openStream() [Don't open socket connections]
  in org.opensearch.indices.replication.SegmentReplicationIT (SegmentReplicationIT.java:1355)
Scanned 734 class file(s) for forbidden API invocations (in 1.05s), 1 error(s).

Alternative

I tried walkFileTree alternative but it makes to fail with access denied error.

access denied ("java.io.FilePermission" "file:/Users/singhnjb/.gradle/caches/modules-2/files-2.1/org.apache.lucene/lucene-core/9.7.0-snapshot-4d1ed9e/8e87d93868271da754a7c22517b3dbbcf84fc7f9/lucene-core-9.7.0-snapshot-4d1ed9e.jar!\org.apache.lucene" "read")
java.security.AccessControlException: access denied ("java.io.FilePermission" "file:/Users/singhnjb/.gradle/caches/modules-2/files-2.1/org.apache.lucene/lucene-core/9.7.0-snapshot-4d1ed9e/8e87d93868271da754a7c22517b3dbbcf84fc7f9/lucene-core-9.7.0-snapshot-4d1ed9e.jar!\org.apache.lucene" "read")
	at __randomizedtesting.SeedInfo.seed([ED0C32C5C80EC389:6F82318B95ED42F9]:0)
	at java.base/java.security.AccessControlContext.checkPermission(AccessControlContext.java:488)

        Path uriPath = PathUtils.get(Codec.class.getProtectionDomain().getCodeSource().getLocation().toURI() + "!\\org.apache.lucene");
        Files.walkFileTree(uriPath, new SimpleFileVisitor<Path>() {
            public FileVisitResult visitFile(Path file, BasicFileAttributes attrs) {
                logger.info("--> File {}", file.getFileName());
                return FileVisitResult.CONTINUE;
            }
        });

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/16871/
• CommitID: 623eaa8
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[dreamer-89]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/16871/
• CommitID: 623eaa8
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

#7873

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.search.backpressure.SearchBackpressureIT.testSearchShardTaskCancellationWithHighCpu

• URL: https://build.ci.opensearch.org/job/gradle-check/16872/
• CommitID: 623eaa8
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #7903 (6f33bd9) into main (2a3683e) will increase coverage by 0.01%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##               main    #7903      +/-   ##
============================================
+ Coverage     70.83%   70.84%   +0.01%     
+ Complexity    56340    56318      -22     
============================================
  Files          4701     4701              
  Lines        266595   266595              
  Branches      39101    39101              
============================================
+ Hits         188834   188861      +27     
+ Misses        61803    61710      -93     
- Partials      15958    16024      +66     

see 476 files with indirect coverage changes

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/16990/
• CommitID: 33335f7
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[dreamer-89]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/16990/
• CommitID: 33335f7
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

Looks unrelated.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':distribution:archives:buildLinuxPpc64leTar'.
> Could not resolve all files for configuration ':distribution:archives:jdk_bundled_linux_ppc64le'.
   > Failed to transform linux-20.0.1-ppc64le.tar.gz (adoptium_20:linux:20.0.1) to match attributes {artifactType=directory, jdk=true, org.gradle.status=integration}.
      > Could not find linux-20.0.1-ppc64le.tar.gz (adoptium_20:linux:20.0.1).
        Searched in the following locations:

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/17058/
• CommitID: f42e98f
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.search.backpressure.SearchBackpressureIT.testSearchTaskCancellationWithHighCpu
      1 org.opensearch.monitor.fs.FsHealthServiceTests.testFailsHealthOnHungIOBeyondHealthyTimeout

• URL: https://build.ci.opensearch.org/job/gradle-check/17065/
• CommitID: 6f33bd9
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.