Skip to content

Commit

Permalink
Update python KafkaIO docstring to add use_deprecated_read option
Browse files Browse the repository at this point in the history
  • Loading branch information
jaehyeon-kim committed Sep 28, 2024
1 parent ee604a5 commit 9b28982
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions sdks/python/apache_beam/io/kafka.py
Original file line number Diff line number Diff line change
Expand Up @@ -52,6 +52,18 @@
that to expand transforms. Currently Kafka transforms use the
'beam-sdks-java-io-expansion-service' jar for this purpose.
Note that the KafkaIO read transform can be compiled in two modes
* `ReadFromKafkaViaUnbounded` (legacy)
* `ReadFromKafkaViaSDF` (default)
To use the legacy mode, the `use_deprecated_read` flag should be specified
within the IO expansion service. For example,
kafka.default_io_expansion_service(
append_args=["--experiments=use_deprecated_read"]
)
*Option 2: specify a custom expansion service*
In this option, you startup your own expansion service and provide that as
Expand Down

0 comments on commit 9b28982

Please sign in to comment.