[BUG] Flaky test org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnThirdAttemptAttempt

[ashking94]

Describe the bug
org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnThirdAttemptAttempt Test is flaky.

To Reproduce
Build - https://build.ci.opensearch.org/job/gradle-check/19505/

Expected behavior
Test should pass.

Plugins
Standard

Screenshots
If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

• OS: [e.g. iOS]
• Version [e.g. 22]

Additional context
Add any other context about the problem here.

[reta]

@ashking94 @sachinpkale The issue is back :(:

[org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnSecondAttempt](https://build.ci.opensearch.org/job/gradle-check/19883/testReport/junit/org.opensearch.index.shard/RemoteStoreRefreshListenerTests/testRefreshSuccessOnSecondAttempt/)
[org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnThirdAttempt](https://build.ci.opensearch.org/job/gradle-check/19883/testReport/junit/org.opensearch.index.shard/RemoteStoreRefreshListenerTests/testRefreshSuccessOnThirdAttempt/)

[1] https://build.ci.opensearch.org/job/gradle-check/19883/
[2] https://build.ci.opensearch.org/job/gradle-check/19884

[Rishikesh1159]

@reta Seems like many of recent gradle check failures are happening with RemoteStoreRefreshListenerTests failures. I think this PR: #7119 which was recently merged is causing the gradle check to fail frequently. Will mute RemoteStoreRefreshListenerTests for now until it is fixed.

[ashking94]

@reta The flaky tests encountered earlier has been fixed with #8550. The continuous failures coming now have come due to #7119 as mentioned by @Rishikesh1159.

[reta]

Thanks @ashking94 , the cause may change but the issue is sadly back

[ashking94]

I am closing this issue and tracking it in a new issue (#8631) as the issue itself is a different one caused on account of retry not being handled correctly in the above mentioned PR.