Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use smaller snapshot threadpool size on small nodes #92392

Merged
merged 1 commit into from
Dec 16, 2022

Conversation

pxsalehi
Copy link
Member

@pxsalehi pxsalehi commented Dec 15, 2022

While on larger data nodes (>= 750MB max heap), larger snapshot
threadpool size improves snapshotting on high latency blob stores
(#90282), smaller instances
can run into OOM issues and need a smaller snapshot threadpool size.
Here, for these small nodes we revert back to the pool size pre-8.6.

Closes #92410

@pxsalehi pxsalehi added >non-issue :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs v8.6.1 labels Dec 15, 2022
@elasticsearchmachine elasticsearchmachine added v8.7.0 Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. labels Dec 15, 2022
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@pxsalehi
Copy link
Member Author

This should probably go to 8.6.0 not 8.6.1.

Copy link
Contributor

@henningandersen henningandersen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@pxsalehi pxsalehi merged commit e023213 into elastic:main Dec 16, 2022
pxsalehi added a commit to pxsalehi/elasticsearch that referenced this pull request Dec 16, 2022
While on larger data nodes (>= 750MB max heap), larger snapshot
threadpool size improves snapshotting on high latency blob stores
(elastic#90282), smaller instances
can run into OOM issues and need a smaller snapshot threadpool size.
Here, for these small nodes we revert back to the pool size pre-8.6.

Closes elastic#92410
elasticsearchmachine pushed a commit that referenced this pull request Dec 16, 2022
While on larger data nodes (>= 750MB max heap), larger snapshot
threadpool size improves snapshotting on high latency blob stores
(#90282), smaller instances
can run into OOM issues and need a smaller snapshot threadpool size.
Here, for these small nodes we revert back to the pool size pre-8.6.

Closes #92410
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs >non-issue Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v8.6.0 v8.7.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Nodes with little heap memory may OOME while snapshotting
3 participants