Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add options for calling elastic pipelines from events #10502

Closed
zpriddy opened this issue Jan 24, 2022 · 0 comments · Fixed by #10505
Closed

Add options for calling elastic pipelines from events #10502

zpriddy opened this issue Jan 24, 2022 · 0 comments · Fixed by #10505
Labels
area/elasticsearch feature request Requests for new plugin and for new features to existing plugins

Comments

@zpriddy
Copy link
Contributor

zpriddy commented Jan 24, 2022

Feature Request

Proposal:

Add in an option to set a pipeline flag based off of tags or default pipeline for the elasticsearch output plugin. This will make the elastic output plugin more flexible to custom pipeline transforms in elastic.

Current behavior:

No option to call pipelines in elastic.

Desired behavior:

Add in two new plugin inputs as shown below. ( I will be attaching a PR with this issue where the changes have been applied. )

  ## Pipeline Config
  ## To use a ingest pipeline, set this to the name of the pipeline you want to use.
  # use_pipeline = "my_pipeline"
  ## Additionally, you can specify a tag name using the notation {{tag_name}}
  ## which will be used as part of the pipeline name. If the tag does not exist,
  ## the default pipeline will be used as the pipeline. If a default pipeline is not
  ## set, then no pipeline will be used,
  # use_pipeline = "{{es_pipeline}}"
  # default_pipeline = "my_pipeline"

Use case:

This allows us to do transforms or normalization on metrics in elastic using elastic pipelines, letting us form more complex nested metrics per the elastic ECS format than telegraf natively supports.

@zpriddy zpriddy added the feature request Requests for new plugin and for new features to existing plugins label Jan 24, 2022
zpriddy added a commit to zpriddy/telegraf that referenced this issue Jan 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/elasticsearch feature request Requests for new plugin and for new features to existing plugins
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant