Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Metricbeat][Kubernetes] Share watchers between metricsets #37332

Merged
merged 76 commits into from
Apr 3, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
76 commits
Select commit Hold shift + click to select a range
fab1407
Share watchers between metricsets.
constanca-m Dec 7, 2023
888dfbe
update CHANGELOG-developer.next.asciidoc
constanca-m Dec 7, 2023
e56dc9a
fix lint error.
constanca-m Dec 7, 2023
5ebc1b3
- Remove getResourceMetadataWatchers
constanca-m Dec 7, 2023
7c62943
Merge branch 'main' into fix-multiple-watchers
constanca-m Dec 26, 2023
8dd0ad6
Move map initialization to kubernetes top level
constanca-m Dec 27, 2023
3e55e7b
Merge branch 'main' into fix-multiple-watchers
constanca-m Dec 27, 2023
15de770
Refactor function name and add comments
constanca-m Jan 8, 2024
c3f57c4
- Rename resourcesUsing
constanca-m Jan 26, 2024
81bc171
Use metricset to distinguish between the ones that are using which re…
constanca-m Jan 26, 2024
6696438
Merge branch 'main' into fix-multiple-watchers
constanca-m Jan 26, 2024
809a442
goimports
constanca-m Jan 26, 2024
b76e38d
run mage check and make update
constanca-m Jan 26, 2024
4cc8a47
Pass add resource metadata instead of whole config.
constanca-m Jan 29, 2024
ab475d1
Refactor watch options to include namespace only when necessary
constanca-m Jan 29, 2024
eac4bde
Revert createMetaGen - removed namespace
constanca-m Jan 29, 2024
13e33a0
Revert createMetaGen - removed namespace
constanca-m Jan 29, 2024
688c406
remove log library
constanca-m Jan 30, 2024
e9783e0
add enrichers to watchers.
constanca-m Feb 2, 2024
c8a41cd
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 2, 2024
8e66700
Add metadataEvents to watcher
constanca-m Feb 5, 2024
83ba2cb
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 5, 2024
0d248ff
Add metadataEvents to watcher
constanca-m Feb 6, 2024
2df0188
Add ids to metadataEvents instead of whole object
constanca-m Feb 6, 2024
8d556e4
Pass metadata.MetaGen and *metadata.Resource as parameters to enricher
constanca-m Feb 6, 2024
0b61c02
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 6, 2024
f1de117
- Save enrichers as map to avoid duplicates in list
constanca-m Feb 7, 2024
25d9b05
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 7, 2024
186032e
- Remove extras : and / on the resources names
constanca-m Feb 7, 2024
65beebe
Reuse accessor.GetNamespace() variable
constanca-m Feb 7, 2024
59a4295
Avoid concurrent goroutine when using handler functions
constanca-m Feb 8, 2024
5f736ac
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 8, 2024
abc0201
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
cb77cd8
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
3a67987
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
f2d65a4
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
1d1a142
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
992400e
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
563cce7
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
9170619
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
014d255
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
ed338f7
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
10bd3c3
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
8c05496
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
b55176a
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
d1506ba
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
68471b8
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
63cb59e
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
8be51ea
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
7aedbe8
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
a902efe
Update metricbeat/module/kubernetes/util/kubernetes.go
constanca-m Feb 8, 2024
dd8e32c
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 8, 2024
60e6556
run mage check and make update
constanca-m Feb 8, 2024
d9e030a
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 8, 2024
adfce46
adjust to node scope
constanca-m Feb 13, 2024
354cf73
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 13, 2024
15b673a
update current watcher to restart watcher
constanca-m Feb 14, 2024
57135c9
Update all watchers - current and extra - according to watcher options
constanca-m Feb 14, 2024
519e3fb
Update go.mod
constanca-m Feb 19, 2024
a888b88
Merge branch 'main' into fix-multiple-watchers
constanca-m Feb 19, 2024
74d51e2
Add geteventhandler to mockwatcher
constanca-m Feb 19, 2024
b51c873
update NOTICE.txt
constanca-m Feb 19, 2024
64ac188
update NOTICE.txt
constanca-m Feb 19, 2024
d41e837
Never restart extra watchers
MichaelKatsoulis Feb 22, 2024
8fcdfc2
Set resourceMetaWatcher as started
MichaelKatsoulis Feb 22, 2024
a7f709a
Add a markdown with detailed explanation of metadata enrichment
MichaelKatsoulis Mar 13, 2024
21f7503
Update metricbeat/module/kubernetes/util/enrichers.md
constanca-m Mar 25, 2024
07819eb
Update code comments and remove enrichers.md
MichaelKatsoulis Mar 27, 2024
8fa7599
Update go.mod
MichaelKatsoulis Mar 27, 2024
64815dc
Merge remote-tracking branch 'upstream/main' into fix-multiple-watchers
MichaelKatsoulis Mar 27, 2024
38d44f4
Update metricbeat/module/kubernetes/util/kubernetes.go
MichaelKatsoulis Mar 28, 2024
a586db9
Merge branch 'main' into fix-multiple-watchers
constanca-m Apr 2, 2024
53fd63a
Update go.mod and add comment about lock
constanca-m Apr 2, 2024
b012f02
Update comment about lock
constanca-m Apr 2, 2024
f9f6f0a
Merge branch 'main' into fix-multiple-watchers
constanca-m Apr 3, 2024
92c3d5b
mage check
constanca-m Apr 3, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,6 @@ module github.com/elastic/beats/v7

go 1.21

// replace github.com/elastic/elastic-agent-autodiscover => /Users/michaliskatsoulis/go/src/github.com/elastic/elastic-agent-autodiscover
require (
cloud.google.com/go/bigquery v1.55.0
cloud.google.com/go/monitoring v1.16.0
Expand Down
2 changes: 1 addition & 1 deletion metricbeat/module/kubernetes/util/kubernetes.go
Original file line number Diff line number Diff line change
Expand Up @@ -325,7 +325,7 @@
}

// addToMetricsetsUsing adds metricset identified by metricsetUsing to the list of resources using the shared watcher
// identified by resourceName.
// identified by resourceName. The caller of this function should be holding the lock.
constanca-m marked this conversation as resolved.
Show resolved Hide resolved
func addToMetricsetsUsing(resourceName string, metricsetUsing string, resourceWatchers *Watchers) {
constanca-m marked this conversation as resolved.
Show resolved Hide resolved
resourceWatchers.lock.Lock()
defer resourceWatchers.lock.Unlock()
Expand Down Expand Up @@ -551,8 +551,8 @@
return &nilEnricher{}
}

var specificMetaGen metadata.MetaGen

Check failure on line 554 in metricbeat/module/kubernetes/util/kubernetes.go

View workflow job for this annotation

GitHub Actions / lint (darwin)

specificMetaGen declared and not used (typecheck)
var generalMetaGen *metadata.Resource

Check failure on line 555 in metricbeat/module/kubernetes/util/kubernetes.go

View workflow job for this annotation

GitHub Actions / lint (darwin)

generalMetaGen declared and not used (typecheck)
// Create the metadata generator to be used in the watcher's event handler.
// Both specificMetaGen and generalMetaGen implement Generate method for metadata collection.
if resourceName == ServiceResource || resourceName == PodResource {
Expand Down
Loading