-
Notifications
You must be signed in to change notification settings - Fork 24.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cache DiscoveryNode#trimTier
Result
#80179
Cache DiscoveryNode#trimTier
Result
#80179
Conversation
No need to recompute this over and over. This is the most expensive part of `FilterAllocationDecider` in benchmarking. Since we already cache the filter itself on the `IndexMetadata`, we can just cache the trimmed version also and `FilterAllocationDecider` effectively disappears from profiling. Also, made the filter immutable (which should as a side-effect also make it faster when iterating over it in the match method).
Pinging @elastic/es-distributed (Team:Distributed) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok with me - I left a couple of nits.
DiscoveryNodeFilters(OpType opType, Map<String, String[]> filters) { | ||
this.opType = opType; | ||
this.filters = filters; | ||
this.filters = Map.copyOf(filters); | ||
this.trimmed = doTrim(this); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nit: could we avoid even calling this when constructing the trimmed filters? Seems unnecessary to walk the filters twice just to check that trimming actually worked.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actually ... we can just avoid that walk altogether in 8
:) Missed that fact earlier, but we don't really need to walk the map in 8
because we're only filtering out a specific key (and null
which I moved elsewhere but I think that filtering is unused ... just didn't want to change behavior here).
Simplified accordingly now
@@ -66,9 +65,13 @@ public static DiscoveryNodeFilters buildFromKeyValue(OpType opType, Map<String, | |||
|
|||
private final OpType opType; | |||
|
|||
@Nullable | |||
private final DiscoveryNodeFilters trimmed; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Naming nit: would be good to mention that it's the tier preference that was trimmed - withoutTierPreferences
or similar perhaps?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
++ sounds good, renamed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Thanks David! |
No need to recompute this over and over. This is the most expensive part of
FilterAllocationDecider
in benchmarking. Since we already cache the filter itselfon the
IndexMetadata
, we can just cache the trimmed version also andFilterAllocationDecider
effectively disappears from profiling.Also, made the filter immutable (which should as a side-effect also make it faster
when iterating over it in the match method).
relates #77466