From 411d92aa42f1d354ce0511b4e69dcb49ab3aa6e1 Mon Sep 17 00:00:00 2001 From: William Easton Date: Wed, 6 Nov 2024 11:43:41 -0600 Subject: [PATCH 1/3] Update input-kafka.asciidoc to indicate required version for Kafka 4.0 --- filebeat/docs/inputs/input-kafka.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/filebeat/docs/inputs/input-kafka.asciidoc b/filebeat/docs/inputs/input-kafka.asciidoc index ee0cd7842a46..69e39afa0ff7 100644 --- a/filebeat/docs/inputs/input-kafka.asciidoc +++ b/filebeat/docs/inputs/input-kafka.asciidoc @@ -89,7 +89,7 @@ The Kafka client id (optional). [float] ===== `version` -The version of the Kafka protocol to use (defaults to `"1.0.0"`). +The version of the Kafka protocol to use (defaults to `"1.0.0"`). When using Kafka 4.0 and newer, the version must be set to at least `"2.1.0"`. [float] ===== `initial_offset` From 05df546e0fd84df12c5653eaa6b86ac127e5fed5 Mon Sep 17 00:00:00 2001 From: William Easton Date: Thu, 7 Nov 2024 10:45:16 -0600 Subject: [PATCH 2/3] Include updates to Kafka output documentation --- libbeat/outputs/kafka/docs/kafka.asciidoc | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/libbeat/outputs/kafka/docs/kafka.asciidoc b/libbeat/outputs/kafka/docs/kafka.asciidoc index 9907cad61c29..00de45d2c81c 100644 --- a/libbeat/outputs/kafka/docs/kafka.asciidoc +++ b/libbeat/outputs/kafka/docs/kafka.asciidoc @@ -44,7 +44,7 @@ endif::[] ==== Compatibility This output can connect to Kafka version 0.8.2.0 and later. Older versions -might work as well, but are not supported. +might work as well, but are not supported. When using Kafka 4.0 and newer, the version must be set to at least `"2.1.0"` ==== Configuration options @@ -69,7 +69,7 @@ The cluster metadata contain the actual Kafka brokers events are published to. ===== `version` -Kafka protocol version that {beatname_uc} will request when connecting. Defaults to 1.0.0. +Kafka protocol version that {beatname_uc} will request when connecting. Defaults to 1.0.0. When using Kafka 4.0 and newer, the version must be set to at least `"2.1.0"` Valid values are all kafka releases in between `0.8.2.0` and `2.6.0`. @@ -300,7 +300,7 @@ The keep-alive period for an active network connection. If 0s, keep-alives are d ===== `compression` -Sets the output compression codec. Must be one of `none`, `snappy`, `lz4`, `gzip` and `zstd`. The default is `gzip`. +Sets the output compression codec. Must be one of `none`, `snappy`, `lz4` and `gzip`. The default is `gzip`. [IMPORTANT] .Known issue with Azure Event Hub for Kafka From 337f4f4fe4ccb1c765e1c8d8db76c456076a3135 Mon Sep 17 00:00:00 2001 From: William Easton Date: Mon, 18 Nov 2024 16:08:28 -0600 Subject: [PATCH 3/3] Undo change to compression info --- libbeat/outputs/kafka/docs/kafka.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/libbeat/outputs/kafka/docs/kafka.asciidoc b/libbeat/outputs/kafka/docs/kafka.asciidoc index 00de45d2c81c..286b894e584d 100644 --- a/libbeat/outputs/kafka/docs/kafka.asciidoc +++ b/libbeat/outputs/kafka/docs/kafka.asciidoc @@ -300,7 +300,7 @@ The keep-alive period for an active network connection. If 0s, keep-alives are d ===== `compression` -Sets the output compression codec. Must be one of `none`, `snappy`, `lz4` and `gzip`. The default is `gzip`. +Sets the output compression codec. Must be one of `none`, `snappy`, `lz4`, `gzip` and `zstd`. The default is `gzip`. [IMPORTANT] .Known issue with Azure Event Hub for Kafka