Add cluster default remote store translog buffer interval setting #9574
Labels
enhancement
Enhancement or improvement to existing feature or request
Storage:Durability
Issues and PRs related to the durability framework
Storage
Issues and PRs relating to data and metadata storage
v2.10.0
Is your feature request related to a problem? Please describe.
This proposes to introduce a dynamic NodeScope settings i.e. cluster default remote store translog buffer interval setting. The
index.remote_store.translog.buffer_interval
setting currently has a default value of 650 ms which is picked up when the user does not provide an explicit index setting for the same. The 650ms value is known to outperform document replication index in terms of indexing throughput and latency with lesser CPU and memory consumption under settings with so workload (3 shard 1 replica, 3 cluster manager + 3 data nodes, aws instance type - r5.xlarge). However, the same buffer interval might not be the most suitable value for other workloads and configuration. Hence, there arises a need to keep the default configurable to allow the user to tune this and set a default that is most suitable to their needs.Expected behaviour with the new setting -
index.remote_store.translog.buffer_interval
will use the cluster default.Describe the solution you'd like
Introduce the setting as mentioned above.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered: