[Remote Store] Add support to run SegRep integ tests using remote store settings

[sachinpkale]

Signed-off-by: Sachin Kale [email protected]

Description

• We want to test various scenarios involving replica promotion, peer recovery, index close and re-open with remote store.
• These scenarios are already being tested in various integ tests of Segment Replication.
• In this change, we re-use the same tests by enabling remote store settings.

Issues Resolved

• [BUG] Assertion failure in IndexShard.updateGlobalCheckpointOnReplica() when remote translog is enabled #6193
• [BUG] Assertion failure in replica promotion using remote translog #6195

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/10665/
• CommitID: 162cdf9
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/10667/
• CommitID: e8cb7f0
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/10672/
• CommitID: 338f85b
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/10705/
• CommitID: 7f9c8b4
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/10708/
• CommitID: 46dcbc4
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/10757/
• CommitID: 09e9453
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.snapshots.DedicatedClusterSnapshotRestoreIT.testIndexDeletionDuringSnapshotCreationInQueue
      1 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testIndexReopenClose

• URL: https://build.ci.opensearch.org/job/gradle-check/10761/
• CommitID: a301daf
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[sachinpkale]

Seeing intermittent issues with org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testIndexReopenClose. Looking into it.

[sachinpkale]

IMO, this update should happen in IndexShard instead of RemoteFsTranslog. As part of recovery, we can download the translog files and update the replicationTracker's global checkpoint.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/10771/
• CommitID: ce89d5d
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/10772/
• CommitID: 580bf9e
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.cluster.allocation.AwarenessAllocationIT.testThreeZoneOneReplicaWithForceZoneValueAndLoadAwareness

• URL: https://build.ci.opensearch.org/job/gradle-check/10826/
• CommitID: a675b53
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[sachinpkale]

Closing this PR as created new one with refactored translog download flow: #6405