Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Elasticsearch 1.5 to OpenSearch 2 #1070

Open
sumobrian opened this issue Oct 13, 2024 · 0 comments
Open

Elasticsearch 1.5 to OpenSearch 2 #1070

sumobrian opened this issue Oct 13, 2024 · 0 comments
Labels
enhancement New feature or request MAv2.3

Comments

@sumobrian
Copy link
Collaborator

sumobrian commented Oct 13, 2024

Is your feature request related to a problem?

Lack of support of Elastcisearch 1.x as a source prevents users from performing multi-version hops during migrations to the latest version of OpenSearch.

What solution would you like?

All products within the migration repo will support multi-version hops, allowing users to directly migrate to the latest version of OpenSearch from ElasticSearch 1.x. This should be supported across all migration paths, including metadata migrations, existing data migrations with RFS, and live capture with Capture and Replay.

Additionally, while not all transformations required for metadata, existing data, and live traffic will be supported "out of the box," there should be a mechanism for users performing such migrations to add custom transformations to the OpenSearch-Migrations transformation framework. This would allow for flexibility in handling unique data structures or transformations that may be required for successful migration.

What alternatives have you considered?

An alternative would be performing step-by-step migrations through intermediate versions, but this is time-consuming, complex, and could result in increased downtime or potential data inconsistencies.

Do you have any additional context?

The feature should account for the Lucene compatibility between versions and ensure that indices created in earlier versions are properly handled without the need for manual reindexing or intermediate version upgrades. This would greatly enhance user experience and reduce migration friction across metadata migrations, data migrations using RFS, and Capture and Replay features. By providing the ability for users to add transformations to the framework, we enable a more adaptable and extensible migration path for different use cases.

@sumobrian sumobrian added enhancement New feature or request untriaged and removed untriaged labels Oct 13, 2024
@sumobrian sumobrian changed the title [FEATURE] Add Support for Elasticsearch 1.x to migrate to the latest version of OpenSearch 2.<latest> Elasticsearch 1.5 to OpenSearch 2 Oct 23, 2024
@sumobrian sumobrian moved this from 6 Months - 1 Year to 3-6 Months in OpenSearch Migrations - Roadmap Dec 15, 2024
@sumobrian sumobrian added MAv2.3 and removed MAv4.0 labels Dec 15, 2024
@AndreKurait AndreKurait changed the title Elasticsearch 1.5 to OpenSearch 2 Elasticsearch 1, 5 to OpenSearch 2 Dec 16, 2024
@AndreKurait AndreKurait changed the title Elasticsearch 1, 5 to OpenSearch 2 Elasticsearch 1.5 to OpenSearch 2 Dec 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request MAv2.3
Projects
Status: 3-6 Months
Development

No branches or pull requests

1 participant