Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhanced age filter to perform limit calcs internally using dynamically fetched limit setting #4

Closed
wants to merge 11 commits into from

Conversation

richard-mauri
Copy link

@richard-mauri richard-mauri commented Oct 9, 2020

This enhancement to the logstash age filter plugin optionally invokes a remote "limit service" to acquire a limit setting. The limit service can be polled at a scheduled interval.
The age plugin then performs the caculation if the event is older than that limit and sets a field if it is or not.
The

This was motivated by the need to be able to remove hard-coded limit setttings and associated calculation from the pipeline filter config file, and instead query and dynamically the limit settings without changing a config file and restarting or signalling logstash.

It also demonstrates how to use the elasticsearch cluster settings metadata as the limit service.

@richard-mauri
Copy link
Author

richard-mauri commented Oct 9, 2020

I know the ascidoc needs attention; I'm not sure how to update it from the comments in the source file.
I hate to copy/paste.

@richard-mauri richard-mauri changed the title Enhanced age filter to perform limit cals internally using dynamially fetched limit setting Enhanced age filter to perform limit calcs internally using dynamially fetched limit setting Oct 9, 2020
@richard-mauri richard-mauri changed the title Enhanced age filter to perform limit calcs internally using dynamially fetched limit setting Enhanced age filter to perform limit calcs internally using dynamically fetched limit setting Oct 9, 2020
@cla-checker-service
Copy link

cla-checker-service bot commented Oct 9, 2020

❌ Author of the following commits did not sign a Contributor Agreement:
, , 37e18b4, , , , , , , ,

Please, read and sign the above mentioned agreement if you want to contribute to this project

@richard-mauri
Copy link
Author

richard-mauri commented Oct 9, 2020

I filed a contributor agreement on another pull request.
It goes nowhere; in other words the response to the contributor form says "elastic will get back to you once it is signed by everybody". Well, it must get stalled as I never get a confirmation and there is no link to track the state of the confirmation....

richard-mauri and others added 2 commits October 12, 2020 08:56
Let's see if I can deploy thisenhanced  age filter
@richard-mauri
Copy link
Author

I had to receate the repo: It is here: https://github.com/richard-mauri/logstash-filter-age

@richard-mauri
Copy link
Author

closing and opening a new pr

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants