[Searchable Snapshot] Implement disk reservation logic to be used for local file system cache #5508
Labels
distributed framework
enhancement
Enhancement or improvement to existing feature or request
Indexing & Search
Referring to #4964,
Cache Disk reservation logic will impact all of:
NodesStats
as fs stats need to take into consideration the cache reserved sizeDiskThresholdDecider
once monitor service having the reservation logic injected it should work out of the boxMonitorService
need to take into consideration the cache reserved sizeorg.opensearch.cluster.ClusterInfo::reservedSpace
org.opensearch.cluster.InternalClusterInfoService::buildShardLevelInfo
org.opensearch.index.store.StoreStats##reservedSize
so that
org.opensearch.cluster.routing.allocation.DiskThresholdMonitor
and
org.opensearch.cluster.routing.allocation.decider.DiskThresholdDecider
take into consideration the new disk reservation logic
Reservation Logic
When creating the cache, a validations are needed to make sure:
cluster.routing.allocation.disk.watermark.high
andcluster.routing.allocation.disk.watermark.low
and so onOutcome of this
add fields
reservedCacheSize
andcurrentCacheSize
toorg.opensearch.env.NodeEnvironment.NodePath
and make these fields reflected correctly in
org.opensearch.monitor.fs.FsProbe#getFSInfo
to have semantic ofgiven Cache max reserved size, current cache occupied size, Implement size reservation logic to be reflected on NodesStats::FileSystemStats, Deciders, Monitoring Service
The text was updated successfully, but these errors were encountered: