[processor/filter] Add ability to filter out data points

[adam-kiss-sg]

Component(s)

processor/filter

Is your feature request related to a problem? Please describe.

I would like to be able to drop specific datapoints from a metric.

To be more specifix, i would like to be able to only keep datapoints emitted from spanmetrics processor that has a span.kind: "SPAN_KIND_SERVER" attribute on the datapoints.

My current config:

  filter/spanmetrics: 
    metrics:
      include:
        match_type: expr
        expressions:
          - MetricName in ["calls_total", "latency"] && Label("span.kind") == "SPAN_KIND_SERVER"

Example metrics:

ResourceMetrics #0
Resource SchemaURL: 
ScopeMetrics #0
ScopeMetrics SchemaURL: 
InstrumentationScope spanmetricsprocessor 
Metric #0
Descriptor:
     -> Name: calls_total
     -> Description: 
     -> Unit: 
     -> DataType: Sum
     -> IsMonotonic: true
     -> AggregationTemporality: Cumulative
NumberDataPoints #0
Data point attributes:
     -> service.name: Str(dummy-service)
     -> operation: Str(middleware - query)
     -> span.kind: Str(SPAN_KIND_INTERNAL)
     -> status.code: Str(STATUS_CODE_UNSET)
     -> http.method: Str(UNKOWN)
StartTimestamp: 2022-11-21 09:37:33.646666564 +0000 UTC
Timestamp: 2022-11-21 09:38:23.476303012 +0000 UTC
Value: 6
NumberDataPoints #1
Data point attributes:
     -> service.name: Str(dummy-service)
     -> operation: Str(GET /healthz)
     -> span.kind: Str(SPAN_KIND_SERVER)
     -> status.code: Str(STATUS_CODE_UNSET)
     -> net.host.port: Int(80)
     -> http.method: Str(GET)
     -> http.status_code: Int(200)
StartTimestamp: 2022-11-21 09:37:33.646666564 +0000 UTC
Timestamp: 2022-11-21 09:38:23.476303012 +0000 UTC
Value: 6

Currently if at least 1 datapoint matches my expression, then the whole metric is kept, with all datapoints.

Describe the solution you'd like

Add an option to filter out individual datapoints with expr filter, instead of whole metrics.

Describe alternatives you've considered

see: #16388

Additional context

No response

[github-actions]

Pinging code owners:

• processor/filter: @boostchicken

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[adam-kiss-sg]

Closed by #16369