Read write ephemeral objects for remote publication of cluster state

[shiv0408]

Description

The changes include modification in RemoteClusterStateService to enable uploading the ephemeral objects required for publication of cluster state through remote store. Also, added a method to read the Cluster State Attributes such as IndexMetadata, GlobalMetadata attributes from remote store in parallel. Read will be crucial part for publication as each follower node will be downloading the updated state from remote.

Related Issues

Resolves #13728
Resolves #13729
Resolves #14109

Check List

• Functionality includes testing.
• API changes companion pull request created, if applicable.
• Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[github-actions]

❌ Gradle check result for 4671704: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[github-actions]

❌ Gradle check result for d7c25e6: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[github-actions]

❌ Gradle check result for 3467ca7: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[github-actions]

❌ Gradle check result for 0391436: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[github-actions]

❕ Gradle check result for 7a05c8e: UNSTABLE

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Attention: Patch coverage is 56.81818% with 209 lines in your changes missing coverage. Please review.

Project coverage is 71.64%. Comparing base (b15cb0c) to head (7a05c8e).
Report is 405 commits behind head on main.

Files	Patch %	Lines
...arch/gateway/remote/RemoteClusterStateService.java	50.73%	138 Missing and 29 partials ⚠️
...teway/remote/RemoteClusterStateCleanupManager.java	28.12%	13 Missing and 10 partials ⚠️
...pensearch/cluster/RepositoryCleanupInProgress.java	28.57%	9 Missing and 1 partial ⚠️
...ay/remote/RemoteClusterStateAttributesManager.java	70.00%	2 Missing and 1 partial ⚠️
...arch/index/recovery/RemoteStoreRestoreService.java	0.00%	2 Missing ⚠️
...ting/remote/InternalRemoteRoutingTableService.java	96.42%	0 Missing and 1 partial ⚠️
.../routing/remote/NoopRemoteRoutingTableService.java	50.00%	1 Missing ⚠️
...ateway/remote/model/RemoteClusterStateCustoms.java	85.71%	1 Missing ⚠️
server/src/main/java/org/opensearch/node/Node.java	0.00%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main   #14089      +/-   ##
============================================
+ Coverage     71.42%   71.64%   +0.22%     
- Complexity    59978    61967    +1989     
============================================
  Files          4985     5117     +132     
  Lines        282275   291579    +9304     
  Branches      40946    42150    +1204     
============================================
+ Hits         201603   208902    +7299     
- Misses        63999    65421    +1422     
- Partials      16673    17256     +583     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[shwetathareja]

PR has an approval from @Bukhtawar . Providing it another approval to unblock merge as some test fix went in since the last approval.

[shwetathareja]

Providing approval to unblock merge.