Releases
2.2.0
2023-04-20 Version 2.2.0
Features
Support End-to-End Acknowledgments for S3 source (#2394 , #2426 , #2436 , #2458 , #2465 )
Support S3 DLQ for OpenSearch sink (#2298 )
Support Amazon Opensearch Serverless Sink (#2169 )
Support S3 Select in s3
source (#1971 )
Support new list_to_map
processor (#2410 )
Support Snappy compression in s3
source (#2420 )
Add append aggregation action for aggregate processor (#2230 )
Support built-in grok patterns for common use-cases (#2514 )
Enhancements
Improve logging by adding error details to logs (#2391 , #2417 , #2555 , #2448 , #2438 )
Add EventFactory framework to create events (#2378 , #2399 #2426 )
Support routes as an alias to route component (#2550 )
Update Java serialization allowlist to have specific classes for JsonNode (#2376 )
Support configurable retries in OpenSearch sink (#2339 )
Use AwsSdk2Transport with OpenSearch Java client (#1881 )
Add sqsMessagesDeleteFailed to track SQS delete failures (#2450 )
Retry TimeoutException caused by flushing data to buffer in S3 source (#2470 )
Add IAM role validation to S3 source and OpenSearch sink (#2472 )
Allow deprecated name for plugins (#2504 )
Make shutdown behaviour configurable (#2524 )
Add support for document_root_key to configure the key to write to OpenSearch (#2511 )
Support format option in add_entries
processor (#2464 )
Support isolated service map extraction in service-map (#628 )
Bug Fixes
Fix missing data points in EMFLoggingMeterRegistry (#2469 )
Fix Trace analytics sample app requirement dependencies (#2477 )
Shutdown log_generator properly (#2494 )
Fix CSV codec drops data without metrics (#2512 )
Fix bug where Java process doesn't get killed when Data Prepper terminates (#2441 )
Security
Maintenance
Update package name for otel_logs_source from com.amazon to org.opensearch (#2543 )
Updated the following plugin names, otel_trace_raw to otel_traces, otel_metrics_raw_processor to otel_metrics, service_map_stateful to service_map (#2526 )
Move backoff and retry logic to BufferAccumulator (#2481 )
Remove unnecessary calls in file sink. (#2475 )
Clean up un-used Peer Forwarder processor gradle file (#2386 )
Fix Java doc warning (#2396 )
Use Gradle version catalogs for dependency management (#2382 )
Update developer guide links to Documentation (#2367 )
Update log4j-bom to 2.20.0 (#2334 )
Update commons-io to 2.11.0 (#2335 , #2336 )
Update byte-buddy to 1.14.2 (#2407 )
Update randomcutforest to 3.6.0 (#2507 )
Update micrometer-bom to 1.10.5 (#2433 )
Replace Grok debugger in documentation (#2425 )
Test against OpenSearch 2.6.0 version (#2455 )
You can’t perform that action at this time.