Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Remote cluster state] Optimise updating global metadata and index metadata #10645

Closed
dhwanilpatel opened this issue Oct 16, 2023 · 2 comments · Fixed by #12190
Closed

[Remote cluster state] Optimise updating global metadata and index metadata #10645

dhwanilpatel opened this issue Oct 16, 2023 · 2 comments · Fixed by #12190
Assignees
@shiv0408
Labels
Cluster Manager enhancement Enhancement or improvement to existing feature or request Storage:Durability Issues and PRs related to the durability framework Storage:Remote Storage Issues and PRs relating to data and metadata storage v2.15.0 Issues and PRs related to version 2.15.0

Comments

@dhwanilpatel
Copy link
Contributor

dhwanilpatel commented Oct 16, 2023 •
edited
Loading

Is your feature request related to a problem? Please describe.
For remote cluster state, we are uploading global metadata and index metadata sequentially to remote store. There is scope for improvement here, as we can upload both the files in parallel.

This will help for the cases, where global metadata and index metadata is getting updated in single cluster state update.

Meta issue: #10523
@dhwanilpatel dhwanilpatel added enhancement Enhancement or improvement to existing feature or request untriaged labels Oct 16, 2023
@dhwanilpatel dhwanilpatel mentioned this issue Oct 16, 2023
Merged
7 tasks
@linuxpi linuxpi mentioned this issue Oct 30, 2023
Closed
28 tasks
@linuxpi linuxpi added Storage:Durability Issues and PRs related to the durability framework Storage Issues and PRs relating to data and metadata storage v2.12.0 Issues and PRs related to version 2.12.0 labels Oct 30, 2023
@kiranprakash154
Copy link
Contributor

Hi, are we on track for this to be released in 2.12 ?

@shiv0408 shiv0408 mentioned this issue Feb 28, 2024
Merged
8 tasks
@soosinha soosinha added the v2.13.0 Issues and PRs related to version 2.13.0 label Mar 8, 2024
@soosinha soosinha removed the v2.12.0 Issues and PRs related to version 2.12.0 label Mar 8, 2024
@soosinha
Copy link
Member

soosinha commented Mar 8, 2024

This is targetted for 2.13

@shiv0408 shiv0408 moved this from 🆕 New to 🏗 In progress in Cluster Manager Project Board Mar 13, 2024
@shiv0408 shiv0408 removed the v2.13.0 Issues and PRs related to version 2.13.0 label May 16, 2024
@github-project-automation github-project-automation bot moved this from 🏗 In progress to ✅ Done in Cluster Manager Project Board May 16, 2024
@github-project-automation github-project-automation bot moved this from 🆕 New to ✅ Done in Storage Project Board May 16, 2024
@shiv0408 shiv0408 self-assigned this May 16, 2024
@shiv0408 shiv0408 added the v2.15.0 Issues and PRs related to version 2.15.0 label May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@shiv0408 shiv0408

Labels
Cluster Manager enhancement Enhancement or improvement to existing feature or request Storage:Durability Issues and PRs related to the durability framework Storage:Remote Storage Issues and PRs relating to data and metadata storage v2.15.0 Issues and PRs related to version 2.15.0
Projects
Cluster Manager Project Board
Status: ✅ Done
Storage Project Board
Status: ✅ Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Split the remote global metadata file to metadata attribute files shiv0408/OpenSearch
6 participants
@shwetathareja @dhwanilpatel @linuxpi @kiranprakash154 @shiv0408 @soosinha