Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

General support for wildcards in spanlogs #2498

Open
steve-hb opened this issue Jan 23, 2025 · 0 comments
Open

General support for wildcards in spanlogs #2498

steve-hb opened this issue Jan 23, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@steve-hb
Copy link
Contributor

steve-hb commented Jan 23, 2025

Request

We should add wildcard support for components allowing for filtering. The one I'm currently struggling with is spanlogs, but I suspect other receivers, processors etc. share the same problem.

Use case

Currently we are only able to include known attributes (see Map#Get for reference), but when using heavy structured logging, this may be problematic - we don't know what developers may decide to include in their logs/metrics. I'm well aware of the drawbacks of having many attributes (performance, data privacy, security etc.) in this kind of data and that, if possible, we should try to discard many unused properties, but since other vendors allow us to freely ingest any kind of attribute and let us at least look at these, we should allow it here too.

In our specific use-case we invested heavily in putting nearly everything we need to know about our application from an observability perspective into span and logs attributes in order to be able to query/filter the data without log.message regex magic. This resulted in likely 100+ different attribute keys we were able to search in - fortunately not necessary to index most of them btw.

Maybe there are some examples or policies regarding this in the Grafana environment, therefore I'm open for comments/thoughts on this one.

PS: I'm open to contribute here again, but would like to have some thoughts/examples first before proposing a solution not aligning with other components.

@steve-hb steve-hb added the enhancement New feature or request label Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant