Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

camelCase topic name not working in file beat #19703

Closed
alihossein opened this issue Jul 7, 2020 · 2 comments
Closed

camelCase topic name not working in file beat #19703

alihossein opened this issue Jul 7, 2020 · 2 comments
Labels
needs_team Indicates that the issue/PR needs a Team:* label

Comments

@alihossein
Copy link

Hi
I useing filebeat version :

filebeat version 7.8.0 (amd64), libbeat 7.8.0 [f79387d32717d79f689d94fda1ec80b2cf285d30 built 2020-06-14 18:15:37 +0000 UTC]

`
when I use camel case style for the topic name (for example haproxyLogs), I see this message:

2020-07-07T16:46:03.233+0430	DEBUG	[kafka]	kafka/client.go:291	Kafka publish failed with: circuit breaker is open
2020-07-07T16:46:03.233+0430	INFO	[publisher]	pipeline/retry.go:221	retryer: send unwait signal to consumer
2020-07-07T16:46:03.233+0430	INFO	[publisher]	pipeline/retry.go:225	  done
2020-07-07T16:46:03.233+0430	DEBUG	[kafka]	kafka/client.go:277	finished kafka batch
2020-07-07T16:46:03.233+0430	DEBUG	[kafka]	kafka/client.go:291	Kafka publish failed with: circuit breaker is open
2020-07-07T16:46:03.233+0430	INFO	[publisher]	pipeline/retry.go:221	retryer: send unwait signal to consumer
2020-07-07T16:46:03.233+0430	INFO	[publisher]	pipeline/retry.go:225	  done
2020-07-07T16:46:03.233+0430	DEBUG	[kafka]	kafka/client.go:277	finished kafka batch
2020-07-07T16:46:03.233+0430	DEBUG	[kafka]	kafka/client.go:291	Kafka publish failed with: circuit breaker is open
2020-07-07T16:46:03.233+0430	INFO	[publisher]	pipeline/retry.go:221	retryer: send unwait signal to consumer
2020-07-07T16:46:03.233+0430	INFO	[publisher]	pipeline/retry.go:225	  done
2020-07-07T16:46:03.233+0430	DEBUG	[kafka]	kafka/client.go:277	finished kafka batch
2020-07-07T16:46:03.233+0430	DEBUG	[kafka]	kafka/client.go:291	Kafka publish failed with: circuit breaker is open
2020-07-07T16:46:03.233+0430	INFO	[publisher]	pipeline/retry.go:221	retryer: send unwait signal to consumer
2020-07-07T16:46:03.233+0430	INFO	[publisher]	pipeline/retry.go:225	  done
2020-07-07T16:46:03.233+0430	DEBUG	[kafka]	kafka/client.go:277	finished kafka batch

so I have decided to change the topic name in the config. (I have used haproxylogs instead of haproxyLogs) and it worked and all logs have produced to topic successfully
what is the problem?

It's my Filebeat's config :

#----------------------------- Kafka output --------------------------------
output.kafka:
  # The Kafka hosts
    hosts: ["xxx.xxx.xxx.xxx:9092","yyy.yyy.yyy.yyy:9092", "zzz.zzz.zzz.zzz:9092"]
  # The Kafka topic
    topic: 'haproxylogs'
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jul 7, 2020
@botelastic
Copy link

botelastic bot commented Jul 7, 2020

This issue doesn't have a Team:<team> label.

@kaiyan-sheng
Copy link
Contributor

Hello @alihossein, this problem should be fixed in #18640. Thanks for creating this issue!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs_team Indicates that the issue/PR needs a Team:* label
Projects
None yet
Development

No branches or pull requests

2 participants