Releases: opensearch-project/opensearch-migrations
1.0.6
What's Changed
- S3Repo now uses Async client and TransferManager by @chelma in #613
- Fix missing gatheringRequest trace for non-blocking requests by @mikaylathompson in #616
- New async bindings by @gregschohn in #614
- Add trafficReplayerMaxUptime parameter and functionality by @AndreKurait in #620
- [Bug] Fix failing Fetch Migration test by @lewijacn in #624
- [Feature] Add Basic Support for OpenSearch Ingestion controls from the Migration Console by @lewijacn in #621
- Remove Migration Console build directory on
gradle clean
by @lewijacn in #625 - Add RFS gradle tasks for jacoco test report and copying of jars by @lewijacn in #626
- [RFS] Refactored DocumentReindexer, HTTP client usage, added a OpenSearchClient by @chelma in #623
- Increase default MAX_PAYLOAD_BYTES_TO_PRINT to 100MiB by @AndreKurait in #622
- Updating maintainers list, adding Peter by @sumobrian in #627
- Upload TrafficCapture test results as artifacts in GitHub workflow by @peternied in #628
- Add a bit of error checking and early exiting to the E2E Setup Script by @mikaylathompson in #631
- Favor ByteBuf Duplicates, NettyJsonContentAuthSigner and StreamChannelConnectionCaptureSerializer Refactoring by @AndreKurait in #615
- Update AsyncLogger.WaitStrategy to Block to fix high CPU by @AndreKurait in #634
- Werkzeug Fix Attempts by @mikaylathompson in #606
- Fix ReadTimeoutException between requests by @AndreKurait in #640
- Fix IllegalArgumentException in Replayer logging by @AndreKurait in #632
- Fix Javadoc by @AndreKurait in #645
- Update base java image to amazoncorretto:11-al2023-headless by @AndreKurait in #635
- Update supported versions in documentation by @sumobrian in #646
New Contributors
- @peternied made their first contribution in #628
Full Changelog: 1.0.5...1.0.6
1.0.5
What's Changed
- Simplify Netty RefCounting and ByteBuf Consumption by @AndreKurait in #592
- RFS now uses reactor-netty for bulk indexing by @chelma in #607
- Change gradle copy to sync to clear old jars by @mikaylathompson in #609
- Enhance matching in multilinePattern by @AndreKurait in #610
- Update version file to 1.0.5 by @sumobrian in #611
Full Changelog: 1.0.4...1.0.5
1.0.4
What's Changed
- Remove parallel test execution and mark long tests by @AndreKurait in #588
- [RFS] Make indexSuffix a parameter by @mikaylathompson in #596
- Downgrade aws-msk-iam-auth to latest good version (2.0.3) by @mikaylathompson in #598
- Mend fixes for various transitive dependencies by @mikaylathompson in #600
- Updated RFS Docker Compose to handle AWS Creds; fix S3Repo bug by @chelma in #597
- Fix final netty-codec-http 4.1.108 spot for Mend by @mikaylathompson in #603
- Add Documentation for proxy failure modes by @AndreKurait in #595
- Enhance logging with Async and high performance appenders by @AndreKurait in #602
Full Changelog: 1.0.3...1.0.4
1.0.3
What's Changed
- Add endpoints and authentication details (including SigV4) as parameters to E2E test script by @okhasawn in #461
- Python Integ Test Updates by @lewijacn in #483
- E2E Integration Test Scripts Improvements by @lewijacn in #484
- Update default Fetch Migration pipeline config file by @okhasawn in #485
- Add Andre to maintainers by @sumobrian in #489
- [Fetch Migration] Suppress exit code for graceful termination (SIGTERM) by @kartg in #478
- [Fetch Migration] Migrate index templates and component templates as a part of metadata migration by @kartg in #477
- Suppress capturing requests from Data Prepper's User Agent for demo setups by @lewijacn in #495
- Add Andre (andrekurait) to list of CODEOWNERS by @sumobrian in #499
- Enhancements in StreamChannelConnectionCaptureSerializer by @AndreKurait in #494
- Replayer instrumentation by @gregschohn in #475
- Otel metrics and traces by @gregschohn in #460
- Suppress capturing responses by @gregschohn in #473
- FEATURE: Add ability to export Kafka records by @lewijacn in #488
- [Fetch Migrations] Use custom exceptions and other readability improvements by @kartg in #506
- Implement TestContainers Unit Tests with CaptureProxy by @AndreKurait in #508
- Gradle Execution Improvements and Upgrades by @AndreKurait in #507
- Fix typo in TimeShifter comments by @AndreKurait in #504
- Flaky tcp connection trace test fix by @gregschohn in #510
- Slow test fixup by @AndreKurait in #509
- Make globally unique default bucket name by @AndreKurait in #514
- Improvements to Fetch Migration stability by @chelma in #516
- 3 changes/fixes around how tuples are output by the replayer. by @gregschohn in #513
- Local maven publish by @AndreKurait in #521
- Update default docker OS version to 2.11 by @lewijacn in #527
- Update dependency org.apache.commons:commons-compress to v1.26.0 by @mend-for-github.aaakk.us.kg in #523
- MIGRATIONS-1519: Add support for providing Fargate CPU arch in CDK by @lewijacn in #520
- CDK Extensibility Improvments by @AndreKurait in #525
- Add fields as protected to allow for class extension by @AndreKurait in #530
- Add support for textFixtures imports with maven local publishing by @AndreKurait in #524
- Enable Gradle Build Scans by @AndreKurait in #518
- Add initial admin env variable for 2.12.0 release by @derek-ho in #480
- Fix some flaky tests that were checking if metrics were being emitted. by @gregschohn in #517
- Minor E2E edits from Jenkins testing by @lewijacn in #531
- Removing MetricsLogger and OpenSearch analytics cluster by @gregschohn in #515
- Rename cdk to follow opensearch-project standards by @AndreKurait in #529
- Capture Proxy, make Kafka send calls fully asynchronous by @AndreKurait in #532
- Fix traffic limiting by @gregschohn in #526
- Initial VPC Validations for CDK by @lewijacn in #533
- Allow proper cleanup of all CDK resources with options by @lewijacn in #535
- Allow Larger Responses by @AndreKurait in #537
- Fix logging and metrics for TrackingKafkaConsumer with partition assignment by @AndreKurait in #534
- Fix connection leaks by @gregschohn in #538
- E2E Script very minor fixes by @lewijacn in #539
- Support Limitless CodedOutputStreams by @AndreKurait in #543
- Adding RFS to the Migration Assistant by @chelma in #545
- Assorted bugfixes and improvements by @gregschohn in #547
- Add task for outputting built jars by @AndreKurait in #549
- RFS can now take the source snapshot by @chelma in #551
- Make RFS runnable as Container by @lewijacn in #550
- Onboard maven publish to 1-click release process by @rishabh6788 in #546
- Update release-drafter.yml to use subshell for traffic capture building by @AndreKurait in #561
- Update release-drafter.yml artifact path by @AndreKurait in #563
- Bug-fix in release jenkinsfile, enable maven autoPublish by @rishabh6788 in #567
- Kafka printer improvements by @AndreKurait in #555
- Add snapshot publish and snapshot version property by @AndreKurait in #568
- Add Artifacts in format for maven central by @AndreKurait in #570
- Fix chunked headers by @AndreKurait in #553
- Remove unused 'arguments' parameter by @rishabh6788 in #574
- Print long running work for debugging by @gregschohn in #564
- Create new context trackers but don't observe them yet by @gregschohn in #557
- Refactor traffic replayer into three files by @gregschohn in #558
- Get with auth header fix by @AndreKurait in #576
- Update dependency io.netty:netty-codec-http to v4.1.108.Final by @mend-for-github.aaakk.us.kg in #542
- Assorted bugfixes by @gregschohn in #579
- Add info about interacting with the docker solution & configure grafana data sources automatically by @mikaylathompson in #552
- Mend Fixes: MSK IAM Auth, Testcontainers, ApacheJMeter by @mikaylathompson in #577
- Fixing some SonarLint findings. by @gregschohn in #580
- Timeouts for target responses by @gregschohn in #584
- Add ExitOnOutOfMemoryError to Docker JVM Options by @AndreKurait in #583
- Update Release Drafter and Traffic Capture to define a variable for publishing version based on tag by @AndreKurait in #582
New Contributors
- @AndreKurait made their first contribution in #494
- @derek-ho made their first contribution in #480
- @rishabh6788 made their first contribution in https://github....
1.0.2
What's Changed
- Add more context for log statements for many thrown exceptions by @gregschohn in #453
- Filter request capturing based upon header matching using regex. @gregschohn in #468
- Bugfix for over-committing KafkaRecords too early by @gregschohn in #468
- Fix Kafka committing errors by @gregschohn in #471
- Sync Kafka Versions to 3.6 across Solution by @lewijacn in #469
- Add ability to use ECS Kafka and OpenSearch containers for testing use cases in CDK by @lewijacn in #472
- Add E2E AWS Integration Testing Script by @lewijacn in #462
- For Fetch Migration, add track_total_hits parameter to doc-count operation by @kartg in #474
Full Changelog: 1.0.1...1.0.2
1.0.1
OpenSearch tooling to assist in OpenSearch upgrades, migrations, and comparisons.
What's Changed
- Update tuple output directory location by @sumobrian in #457
- Blocking traffic source with keep alives by @gregschohn in #456
- Capture Proxy documentation Rev 2 by @lewijacn in #458
Full Changelog: 1.0.0...1.0.1
1.0.0
0.1.0
OpenSearch Migrations - Capture and replay
OpenSearch migration tooling facilitates OpenSearch migrations and upgrades. With these tools, you can set up a proof-of-concept environment locally using Docker containers or deploy to AWS using a one-click deployment script. Once set up and deployed, users can redirect their production traffic from a source cluster to a provisioned target cluster, enabling a comparison of results between the two clusters. All traffic directed to the source cluster is stored for future replay. Meanwhile, traffic to the target cluster is replayed at an identical rate to ensure a direct "apple-to-apple" comparison. This toolset empowers users to fine-tune cluster configurations and manage workloads more effectively.
Full Changelog: https://github.com/opensearch-project/opensearch-migrations/commits/0.1.0