Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement option to create a new warm remote index (with zero replicas) #8447

Open
Tracked by #8446
andrross opened this issue Jul 5, 2023 · 2 comments
Open
Tracked by #8446

Implement option to create a new warm remote index (with zero replicas) #8447

andrross opened this issue Jul 5, 2023 · 2 comments
Assignees
@neetikasinghal
Labels
distributed framework feature New feature or request

Comments

@andrross
Copy link
Member

andrross commented Jul 5, 2023

Desired behavior:

  • A user can tag an index as “warm” and all files will be tracked in the file cache
  • All unreferenced files are evictable from the file cache
  • Evictable files will be evicted when the reserved file cache is full
  • Files not present on local disk will be fetched on-demand using a block-based approach when needed

This has been designed and a rough implementation provided here: https://github.com/neetikasinghal/OpenSearch/tree/new-CD The goal of this task is to complete and clean up that code and merge it to the feature branch.
@andrross andrross added bug Something isn't working untriaged labels Jul 5, 2023
@andrross andrross mentioned this issue Jul 5, 2023
Open
7 tasks
@andrross andrross added distributed framework feature New feature or request and removed bug Something isn't working untriaged labels Jul 5, 2023
@andrross andrross changed the title Implement option to create a new warm remote index (with zero replicas) Implement option to create a new warm remote index (with zero replicas) Jul 5, 2023
@anasalkouz anasalkouz moved this from Todo to In Progress in Concurrent Search Jul 6, 2023
@anasalkouz anasalkouz assigned anasalkouz and unassigned anasalkouz Jul 6, 2023
@neetikasinghal
Copy link
Contributor

I will be working on this.

@neetikasinghal neetikasinghal mentioned this issue Jul 7, 2023
Merged
6 tasks
@neetikasinghal
Copy link
Contributor

PR: #8511

@anasalkouz anasalkouz moved this from In Progress to Done in Concurrent Search Jul 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@neetikasinghal neetikasinghal

Labels
distributed framework feature New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@andrross @neetikasinghal @anasalkouz