Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Autodiscover should not require identical metadata for start/stop events #8863

Closed
andrewvc opened this issue Nov 1, 2018 · 6 comments
Closed
Labels
discuss Issue needs further discussion. enhancement libbeat needs_team Indicates that the issue/PR needs a Team:* label Stalled

Comments

@andrewvc
Copy link
Contributor

andrewvc commented Nov 1, 2018

I'm currently in the process of writing an AWS ELB autodiscover adapter in #8680 .

One design issue I'm hitting, which probably didn't come up before, is that the event data published here is mutable. In other words, an ELB might be in a different state at stop than start, yielding different metadata. This is important because autodiscover de-duplication and stop/start code relies on hashing metadata consistently.

This breaks with AWS autodiscover since a number of items in the metadata are mutable. While it may be possible to remove those, it would be better to not handicap this provider.

I propose that we modify the autodiscover code to have two paths. One for the current method, and the other using a synthetic PK, which in the case of AWS is an item's ARN.

This would mean that we would maintain a second hash table per provider in autodiscover.go for items of this type of the . form map[string][]config, where string is that synthetic PK and []config is the list of configs rendered for that unique resource.

@andrewvc andrewvc added enhancement discuss Issue needs further discussion. libbeat labels Nov 1, 2018
@ruflin
Copy link
Contributor

ruflin commented Nov 1, 2018

@exekias Would be great to get your opinion on this one.

@exekias
Copy link
Contributor

exekias commented Nov 1, 2018

Interestingly enough, I started just this 18h ago: #8851 😄

@exekias
Copy link
Contributor

exekias commented Nov 1, 2018

About having 2 paths: I think we are still on time of going for this new approach and kill the old one. I don't feel really comfortable with dual behavior, as long as we can avoid it.

@andrewvc
Copy link
Contributor Author

andrewvc commented Nov 1, 2018 via email

@botelastic
Copy link

botelastic bot commented Jul 8, 2020

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@botelastic botelastic bot added Stalled needs_team Indicates that the issue/PR needs a Team:* label labels Jul 8, 2020
@botelastic
Copy link

botelastic bot commented Jul 8, 2020

This issue doesn't have a Team:<team> label.

@botelastic botelastic bot closed this as completed Aug 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discuss Issue needs further discussion. enhancement libbeat needs_team Indicates that the issue/PR needs a Team:* label Stalled
Projects
None yet
Development

No branches or pull requests

3 participants