opensearch.release-notes-2.18.0.md

2024-10-28 Version 2.18.0 Release Notes

[2.18.0]

Added

• [Workload Management] Add orchestrator for wlm resiliency (QueryGroupService) (#15925)
• [Offline Nodes] Adds offline-tasks library containing various interfaces to be used for Offline Background Tasks. (#13574)
• Add support for async deletion in S3BlobContainer (#15621)
• [Workload Management] QueryGroup resource cancellation framework changes (#15651)
• [Workload Management] Add QueryGroup Stats API Logic (15777)
• Implement WithFieldName interface in ValuesSourceAggregationBuilder & FieldSortBuilder (#15916)
• Add successfulSearchShardIndices in searchRequestContext (#15967, #16110)
• Fallback to Remote cluster-state on Term-Version check mismatch - (#15424)
• [Tiered Caching] Segmented cache changes (#16047)
• Add support for msearch API to pass search pipeline name - (#15923)
• Add success and failure metrics for async shard fetch (#15976)
• Add support to dynamically resize threadpools size. (#16236)
• [S3 Repository] Change default retry mechanism of s3 clients to Standard Mode (#15978)
• [Workload Management] Add Integration Tests for Workload Management CRUD APIs (#15955)
• Add new metric REMOTE_STORE to NodeStats API response (#15611)
• New phone & phone-search analyzer + tokenizer (#15915)
• Add _list/indices API as paginated alternate to _cat/indices (#14718)
• Add changes to block calls in cat shards, indices and segments based on dynamic limit settings (#15986)
• Flat object field use IndexOrDocValuesQuery to optimize query (#14383)
• Add method to return dynamic SecureTransportParameters from SecureTransportSettingsProvider interface (#16387
• Add _list/shards API as paginated alternate to _cat/shards (#14641)
• [Star Tree - Search] Add support for metric aggregations with/without term query (15289)
• URI path filtering support in cluster stats API (#15938)
• Add support for renaming aliases during snapshot restore (#16292)

Dependencies

• Bump org.apache.logging.log4j:log4j-core from 2.23.1 to 2.24.0 (#15858)
• Bump com.azure:azure-identity from 1.13.0 to 1.13.2 (#15578)
• Bump protobuf from 3.22.3 to 3.25.4 (#15684)
• Bump peter-evans/create-pull-request from 6 to 7 (#15863)
• Bump com.nimbusds:oauth2-oidc-sdk from 11.9.1 to 11.19.1 (#15862)
• Bump com.microsoft.azure:msal4j from 1.17.0 to 1.17.2 (#15945, #16406)
• Bump ch.qos.logback:logback-core from 1.5.6 to 1.5.10 (#15946, #16307)
• Update protobuf from 3.25.4 to 3.25.5 (#16011)
• Bump org.roaringbitmap:RoaringBitmap from 1.2.1 to 1.3.0 (#16040)
• Bump com.nimbusds:nimbus-jose-jwt from 9.40 to 9.41.1 (#16038)
• Bump actions/github-script from 5 to 7 (#16039)
• Bump dnsjava:dnsjava from 3.6.1 to 3.6.2 (#16041)
• Bump com.maxmind.geoip2:geoip2 from 4.2.0 to 4.2.1 (#16042)
• Bump com.maxmind.db:maxmind-db from 3.1.0 to 3.1.1 (#16137)
• Bump Apache lucene from 9.11.1 to 9.12.0 (#15333)
• Bump com.azure:azure-core-http-netty from 1.15.3 to 1.15.5 (#16133, #16311)
• Bump netty from 4.1.112.Final to 4.1.114.Final (#16182)
• Bump com.google.api-client:google-api-client from 2.2.0 to 2.7.0 (#16216)
• Bump com.azure:azure-json from 1.1.0 to 1.3.0 (#16217)
• Bump io.grpc:grpc-api from 1.57.2 to 1.68.0 (#16213)
• Bump org.jline:jline from 3.26.3 to 3.27.0 (#16135)
• Bump com.squareup.okio:okio from 3.9.0 to 3.9.1 (#16212)
• Bump lycheeverse/lychee-action from 1.10.0 to 2.0.2 (#16310)
• Bump com.google.code.gson:gson from 2.10.1 to 2.11.0 (#16308)
• Bump io.grpc:grpc-api from 1.57.2 to 1.68.0 (#16213)
• Bump me.champeau.gradle.japicmp from 0.4.3 to 0.4.4 (#16309)
• Bump com.google.oauth-client:google-oauth-client from 1.35.0 to 1.36.0 (#16306)

Changed

• Add support for docker compose v2 in TestFixturesPlugin (#16049)
• Remove identity-related feature flagged code from the RestController (#15430)
• Remove Identity FeatureFlag (#16024)
• Ensure RestHandler.Wrapper delegates all implementations to the wrapped handler (#16154)
• Enable coordinator search.request_stats_enabled by default (#16290)
• Optimise clone operation for incremental full cluster snapshots (#16296)
• Code cleanup: Remove ApproximateIndexOrDocValuesQuery (#16273)
• Update last seen cluster state in the commit phase (#16215)
• Make multiple settings dynamic for tuning on larger clusters(#16347)

Fixed

• Fix wildcard query containing escaped character (#15737)
• Fix case-insensitive query on wildcard field (#15882)
• Add validation for the search backpressure cancellation settings (#15501)
• Fix search_as_you_type not supporting multi-fields (#15988)
• Avoid infinite loop when flat_object field contains invalid token (#15985)
• Fix infinite loop in nested agg (#15931)
• Fix update settings with null replica not honoring cluster setting bug (#14948)
• Fix race condition in node-join and node-left (#15521)
• Streaming bulk request hangs (#16158)
• Fix warnings from SLF4J on startup when repository-s3 is installed (#16194)
• Fix protobuf-java leak through client library dependencies (#16254)
• Fix multi-search with template doesn't return status code (#16265)
• [Streaming Indexing] Fix intermittent 'The bulk request must be terminated by a newline [\n]' failures #16337)
• Fix wrong default value when setting index.number_of_routing_shards to null on index creation (#16331)
• Fix inefficient Stream API call chains ending with count() (#15386)
• [Workload Management] Make query groups persistent across process restarts #16370
• Fix missing fields in task index mapping to ensure proper task result storage (#16201)
• Fix typo super->sb in method toString() of RemoteStoreNodeAttribute (#15362)
• Fix array hashCode calculation in ResyncReplicationRequest (#16378)
• [Workload Management] Enhance rejection mechanism in workload management (#16417)
• [Workload Management] Fixing Create/Update QueryGroup TransportActions to execute from non-cluster manager nodes (16422)
• Fix flaky test in testApproximateRangeWithSizeOverDefault by adjusting totalHits assertion logic (#16434)