Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snapshot Pagination and Scalability Improvements Backport to 7.x #74676

Conversation

original-brownbear
Copy link
Member

@original-brownbear original-brownbear commented Jun 29, 2021

Backport of the recently introduced snapshot pagination and scalability improvements listed below.
Merged as a single backport because the 7.x and master snapshot status API logic had massively diverged between master and 7.x. With the work in the below PRs, the logic in master and 7.x once again has been aligned very closely again.

#72842
#73172
#73199
#73570
#73952
#74236
#74451 (this one is only partly applicable as it was mainly a change to master to align master and 7.x branches)

@original-brownbear original-brownbear added :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs backport labels Jun 29, 2021
@elasticmachine elasticmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Jun 29, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

This PR returns the get snapshots API to the 7.x format (and transport client behavior) and enhances it for requests that ask for multiple repositories.
The changes for requests that target multiple repositories are:
* Add `repository` field to `SnapshotInfo` and REST response
* Add `failures` map alongside `snapshots` list instead of returning just an exception response as done for single repo requests
* Pagination now works across repositories instead of being per repository for multi-repository requests

closes elastic#69108
closes elastic#43462
original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request Jun 29, 2021
Disabling BwC tests so that elastic#74676 can be merged.
original-brownbear added a commit that referenced this pull request Jun 29, 2021
Disabling BwC tests so that #74676 can be merged.
@original-brownbear original-brownbear merged commit d64a72c into elastic:7.x Jun 29, 2021
@original-brownbear original-brownbear deleted the 7.x-snapshot-backport-madness branch June 29, 2021 13:16
original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request Jun 29, 2021
Now that elastic#74676 has been merged, reenable BwC tests.
original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request Jun 29, 2021
Follow-up to elastic#74676 where I missed a spot in request conversions.
original-brownbear added a commit that referenced this pull request Jun 29, 2021
Now that #74676 has been merged, reenable BwC tests.
original-brownbear added a commit that referenced this pull request Jun 29, 2021
Follow-up to #74676 where I missed a spot in request conversions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v7.14.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants