Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

processor_labels: Add a documentation for processor_labels #1371

Merged
merged 9 commits into from
Jul 26, 2024
1 change: 1 addition & 0 deletions SUMMARY.md
Original file line number Diff line number Diff line change
Expand Up @@ -130,6 +130,7 @@
* [Logfmt](pipeline/parsers/logfmt.md)
* [Decoders](pipeline/parsers/decoders.md)
* [Processors](pipeline/processors/README.md)
* [Labels](pipeline/processors/labels.md)
* [Content Modifier](pipeline/processors/content-modifier.md)
* [Metrics Selector](pipeline/processors/metrics-selector.md)
* [SQL](pipeline/processors/sql.md)
Expand Down
1 change: 1 addition & 0 deletions installation/sources/build-and-install.md
Original file line number Diff line number Diff line change
Expand Up @@ -220,3 +220,4 @@ The following table describes the processors available on this version:
| option | description | default |
| :--- | :--- | :--- |
| [FLB\_PROCESSOR\_METRICS\_SELECTOR](../../pipeline/processors/metrics-selector.md) | Enable metrics selector processor | On |
| [FLB\_PROCESSOR\_LABELS](../../pipeline/processors/labels.md) | Enable metrics label manipulation processor | On |
105 changes: 105 additions & 0 deletions pipeline/processors/labels.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,105 @@
# Labels

The **labels** processor allows you to manipulate the labels of Metrics.

Similar to the functionality exposed by filters, this processor presents a enriching/modifying mechanism to perform such operations for labels manipulation.
The most significant difference is that processors perform better than filters, and when chaining them, there are no encoding/decoding performance penalties.

Note that processors and this specific component can only be enabled using the new YAML configuration format.
Classic mode configuration format doesn't support processors.
cosmo0920 marked this conversation as resolved.
Show resolved Hide resolved

## Configuration Parameters

| Key | Description |
| :---------- | :--- |
| update | Update an existing key with a value into metrics. The key-value pair is required. If the specified key does not exist, the operation is silently failed and no effect. |
| insert | Insert a new key with a value into metrics. The key-value pair is required. |
cosmo0920 marked this conversation as resolved.
Show resolved Hide resolved
cosmo0920 marked this conversation as resolved.
Show resolved Hide resolved
| upsert | Upsert a specific key with a value, the `upsert` operation will try to update the value of the key. If the key does not exist, the key will be created. The key-value pair is required. |
cosmo0920 marked this conversation as resolved.
Show resolved Hide resolved
| delete | Delete a key from the labels of metrics. The key-value pair is required. If the specified key does not exist, the operation is silently failed and no effect. |
| hash | Replace the key value with a hash generated by the SHA-256 algorithm from the specified label name, the binary value generated is finally set as an hex string representation. |
cosmo0920 marked this conversation as resolved.
Show resolved Hide resolved
cosmo0920 marked this conversation as resolved.
Show resolved Hide resolved


cosmo0920 marked this conversation as resolved.
Show resolved Hide resolved
#### Update example

Change the value of the `name` to `fluentbit`:

```yaml
pipeline:
inputs:
- name: fluentbit_metrics
processors:
metrics:
- name: labels
update: name fluentbit
outputs:
- name : stdout
match: '*'
```

#### Insert example

The following example appends the key `agent` with the value `fluentbit` as the label of metrics.
cosmo0920 marked this conversation as resolved.
Show resolved Hide resolved

```yaml
pipeline:
inputs:
- name: fluentbit_metrics
processors:
metrics:
- name: labels
insert: agent fluentbit
outputs:
- name : stdout
match: '*'
```

#### Upsert example

Upsert the value of `name` and insert `fluentbit`:

```yaml
pipeline:
inputs:
- name: fluentbit_metrics
processors:
metrics:
- name: labels
upsert: name fluentbit
outputs:
- name : stdout
match: '*'
```

#### Delete example

Delete containing `name` key from metrics:

```yaml
pipeline:
inputs:
- name: fluentbit_metrics
processors:
metrics:
- name: labels
delete: name
outputs:
- name : stdout
match: '*'
```

#### Hash example

Apply the SHA-1 algorithm for the value of the key `hostname`:

```yaml
pipeline:
inputs:
- name: fluentbit_metrics
processors:
metrics:
- name: labels
hash: hostname
outputs:
- name : stdout
match: '*'
```