Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

KafkaIO should support topic patterns #19217

Closed
kennknowles opened this issue Jun 3, 2022 · 1 comment
Closed

KafkaIO should support topic patterns #19217

kennknowles opened this issue Jun 3, 2022 · 1 comment
Labels
improvement io java kafka P3
Milestone
2.50.0 Release

Comments

@kennknowles
Copy link
Member

For the moment, it is possible to set topics for KafkaIO.Read in 2 ways - one single topic by using withTopic(String) or list of topics by using withTopics(List<String>).

It would make sense to provide another way for this using patterns, based on regular expressions, like withTopics(“org_[0-9]+_source”). In this case, Kafka consumer could discover the topics based on user provided pattern.

Imported from Jira BEAM-5786. Original Jira may contain additional context.
Reported by: aromanenko.
@sjvanrossum sjvanrossum mentioned this issue May 31, 2023
Merged
3 tasks
@Abacn
Copy link
Contributor

Abacn commented Jul 27, 2023

fixed by #26948

@Abacn Abacn closed this as completed Jul 27, 2023
@github-actions github-actions bot added this to the 2.50.0 Release milestone Jul 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
improvement io java kafka P3
Projects
None yet
Milestone
2.50.0 Release
Development

No branches or pull requests
3 participants
@kennknowles @Abacn @damccorm