-
Notifications
You must be signed in to change notification settings - Fork 501
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add remote store main page updates. Add shallow snapshots (#5078)
* Add remote store main page updates. Add shallow snapshots Signed-off-by: Naarcha-AWS <[email protected]> * Add next steps section Signed-off-by: Naarcha-AWS <[email protected]> * Remove old content. Fix link. Fix typo. Signed-off-by: Naarcha-AWS <[email protected]> * Fix link Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _tuning-your-cluster/availability-and-recovery/remote-store/index.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _tuning-your-cluster/availability-and-recovery/remote-store/index.md Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Nathan Bower <[email protected]>
- Loading branch information
Showing
3 changed files
with
87 additions
and
174 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
36 changes: 36 additions & 0 deletions
36
...our-cluster/availability-and-recovery/remote-store/snapshot-interoperability.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,36 @@ | ||
--- | ||
layout: default | ||
title: Shallow snapshots | ||
nav_order: 15 | ||
parent: Remote-backed storage | ||
grand_parent: Availability and recovery | ||
--- | ||
|
||
# Shallow snapshots | ||
|
||
Shallow copy snapshots allow you to reference data from an entire remote-backed segment instead of storing all of the data from the segment in a snapshot. This makes accessing segment data faster than using normal snapshots because segment data is not stored in the snapshot repository. | ||
|
||
## Enabling shallow snapshots | ||
|
||
Use the [Cluster Settings API]({{site.url}}{{site.baseurl}}/api-reference/cluster-api/cluster-settings/) to enable the `remote_store_index_shallow_copy` repository setting, as shown in the following example: | ||
|
||
```bash | ||
PUT _cluster/settings | ||
{ | ||
"persistent":{ | ||
"remote_store_index_shallow_copy": true | ||
} | ||
} | ||
``` | ||
{% include copy-curl.html %} | ||
|
||
Once enabled, all requests using the [Snapshot API]({{site.url}}{{site.baseurl}}/api-reference/snapshots/index/) will remain the same for all snapshots. After the setting is enabled, we recommend not disabling the setting. Doing so could affect data durability. | ||
|
||
## Considerations | ||
|
||
Consider the following before using shallow copy snapshots: | ||
|
||
- Shallow copy snapshots only work for remote-backed indexes. | ||
- All nodes in the cluster must use OpenSearch 2.10 or later to take advantage of shallow copy snapshots. | ||
- There is no difference in file size between standard shards and shallow copy snapshot shards because no segment data is stored in the snapshot itself. | ||
- Searchable snapshots are not supported inside shallow copy snapshots. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters