libbeat/processors/cache: new processor

This is the initial infrastructure for a caching metadata processor to be added. It currently only supports in-memory caching, though both planned cache types are configurable with the file cache being mocked by an in-memory cache. Additional config options are added relative to the RFC, but these are intentionally not documented at this stage.
elastic · Sep 18, 2023 · b8b07d9 · b8b07d9
1 parent 9dcd8be
commit b8b07d9
Show file tree

Hide file tree

Showing 26 changed files with 1,627 additions and 9 deletions.
diff --git a/CHANGELOG-developer.next.asciidoc b/CHANGELOG-developer.next.asciidoc
@@ -170,6 +170,7 @@ The list below covers the major changes between 7.0.0-rc2 and main only.
 - Skip dependabot updates for github.com/elastic/mito. {pull}36158[36158]
 - Add device handling to Okta API package for entity analytics. {pull}35980[35980]
 - Make Filebeat HTTPJSON input process responses sequentially. {pull}36493[36493]
+- Add initial infrastructure for a caching enrichment processor. {pull}[]
 
 ==== Deprecated
 

diff --git a/auditbeat/docs/fields.asciidoc b/auditbeat/docs/fields.asciidoc
@@ -16,6 +16,7 @@ grouped in the following categories:
 
 * <<exported-fields-auditd>>
 * <<exported-fields-beat-common>>
+* <<exported-fields-cache>>
 * <<exported-fields-cloud>>
 * <<exported-fields-common>>
 * <<exported-fields-docker-processor>>
@@ -2479,6 +2480,12 @@ type: keyword
 
 --
 
+[[exported-fields-cache]]
+== Cache fields
+
+Cache processor
+
+
 [[exported-fields-cloud]]
 == Cloud provider metadata fields
 

diff --git a/auditbeat/include/fields.go b/auditbeat/include/fields.go
diff --git a/filebeat/docs/fields.asciidoc b/filebeat/docs/fields.asciidoc
@@ -24,6 +24,7 @@ grouped in the following categories:
 * <<exported-fields-barracuda>>
 * <<exported-fields-beat-common>>
 * <<exported-fields-bluecoat>>
+* <<exported-fields-cache>>
 * <<exported-fields-cef>>
 * <<exported-fields-cef-module>>
 * <<exported-fields-checkpoint>>
@@ -14523,6 +14524,12 @@ type: keyword
 
 --
 
+[[exported-fields-cache]]
+== Cache fields
+
+Cache processor
+
+
 [[exported-fields-cef]]
 == Decode CEF processor fields fields
 

diff --git a/filebeat/include/fields.go b/filebeat/include/fields.go
diff --git a/heartbeat/docs/fields.asciidoc b/heartbeat/docs/fields.asciidoc
@@ -16,6 +16,7 @@ grouped in the following categories:
 
 * <<exported-fields-beat-common>>
 * <<exported-fields-browser>>
+* <<exported-fields-cache>>
 * <<exported-fields-cloud>>
 * <<exported-fields-common>>
 * <<exported-fields-docker-processor>>
@@ -241,6 +242,12 @@ type: integer
 
 --
 
+[[exported-fields-cache]]
+== Cache fields
+
+Cache processor
+
+
 [[exported-fields-cloud]]
 == Cloud provider metadata fields
 

diff --git a/heartbeat/include/fields.go b/heartbeat/include/fields.go
diff --git a/libbeat/processors/cache/_meta/fields.yml b/libbeat/processors/cache/_meta/fields.yml
@@ -0,0 +1,5 @@
+- key: cache
+  title: Cache
+  description: >
+    Cache processor
+  fields: ~