Opentelemetry Collector Data Flow Dashboard Preview

[devrimdemiroz]

Changes

A dashboard that shows Data Flow on Opentelemetry Collector over demo app.

Merge Requirements

Waiting feedback and corrections ...

• CHANGELOG.md updated to document new feature additions
• Appropriate documentation updates in the [docs][]

[austinlparker]

Interesting - couple of notes from running it locally:

• The span export ratio seems fine, but the metric export ratio seems strange?
• Some more notes/annotations in the dashboard about what the actual metrics are measuring would be great.

This seems like a really good resource for people to learn about how to monitor pipelines.

[devrimdemiroz]

Interesting - couple of notes from running it locally:

• The span export ratio seems fine, but the metric export ratio seems strange?
• Some more notes/annotations in the dashboard about what the actual metrics are measuring would be great.

This seems like a really good resource for people to learn about how to monitor pipelines.

The export ratio visibility idea belongs to @jpkrohling . And it is indeed great so that you can spot something is strange. The particular thing about opentelemetry demo app is that the spanmetrics configuration makes it strange. As it loops back within the collector configuration and does not exist among metrics incoming under otelcol_* namespace.

otelcol metrics spreadsheet I deep dived into what is coming. This list also has memory_delimiter, servicegraph processor and more in it. With the new connector system upcoming inside the collector, it might be better. However, it is good to know it is strange. 🤓

I have this as a base for documentation. I can convert it into a markdown format.

[cartersocha]

The dashboard looks great!

Would it be possible to include the service source or slice some of these ingress metrics by attributes like that? Might be another dashboard haha

[devrimdemiroz]

The dashboard looks great!

Would it be possible to include the service source or slice some of these ingress metrics by attributes like that? Might be another dashboard haha

Thanks!
I noted as remarks here, the labels are very limited. I agree. Enhancements on the collector side to be able to distinguish services and pipelines would be necessary.

[austinlparker]

Yeah, if you can get the docs for this into markdown we'd love to pull it into the next release.

[julianocosta89]

Please add a changelog.

[julianocosta89]

LGTM 🤩

[fatsheep9146]

Awesome

[devrimdemiroz]

Thank you for the great comments! 🥳 I hope it will help showcase the value of the OpenTelemetry Collector and make the demo application even more impressive.

[devrimdemiroz]

Documentation PR --> open-telemetry/opentelemetry.io#2535

[devrimdemiroz]

Documentation merged on this one open-telemetry/opentelemetry.io#2569