I want to provide influxdb support

[xrl]

I am trying to write a POC for consumer group monitoring with Influxdb/Grafana/Grafana Alerts. We currently shovel all our stats in influxdb and grafana has developed some robust features for managing alerts (with visual overlay, how nice!).

Would this work be useful to the upstream project? I am writing a notification which batch emits all the consumer group stats on every interval. So not really a notification in the typical sense, but it's convenient to get the callback.

I am bringing in the influxdb go client, so it'll all be native inside the existing executable. With typical support in the config file.

[rkling01]

@xrl we are moving to the same pattern of Influxdb/Grafana/Grafana alerts as well so this would definitely nice!

[sundy-li]

+1 for influxdb support

[ChristianTrolleMikkelsen]

+1 for influxdb support

[toddpalino]

Thanks for the PR @sundy-li. I'll try and get a chance to review this shortly.

[sundy-li]

Hi, in the PR I just emit offsets and lags to influxdb to store the stat of each consumers in kafka clusters, and it works fine with Grafana ui and Grafana alerts to me in recents days, may be the PR is not perfect from now on, I am looking forward to see the Burrow project the be more complete in the future
(BTW I wrote a project named Dcmonitor before, but it only works with kafka 0.82 using zookeeper store, so much excited about offical Burrow project!!!)

[toddpalino]

I'm going to look at this in the rewrite that I'm working on. We can add a notifier for influxdb that will do this work. This will involve me redoing the PR to fit the new model.

[cl0udgeek]

bump and +1!!

[cl0udgeek]

is this one closed now?? See this issue as maybe being closed as stated in this comment? #283 (comment)

[toddpalino]

I think when I went through to actually close them, I ended up not closing this one because we didn't explicitly add influxdb support. As long as the protocol is HTTP, it should be doable with the HTTP notifier, however.

[dmitryilyin]

There is an ongoing effort to make telegraf's input plugin for burrow API here influxdata/telegraf#3489

It can then be used to send metrics to Graphite, InfluxDB, Prometheus and others.

[xmm1989218]

when we can get the feature (influxdb support)?