[MBOX] Remove credentials from origin and tag

This code redefines the method _fix_item for the MBOX raw data to remove credentials that may appear in the origin. Signed-off-by: Jose Javier Merchante <[email protected]>
chaoss · Apr 11, 2024 · 505cd5e · 505cd5e
1 parent 9252163
commit 505cd5e
Show file tree

Hide file tree

Showing 2 changed files with 12 additions and 0 deletions.
diff --git a/grimoire_elk/raw/mbox.py b/grimoire_elk/raw/mbox.py
@@ -23,6 +23,7 @@
 
 from .elastic import ElasticOcean
 from ..elastic_mapping import Mapping as BaseMapping
+from ..enriched.utils import anonymize_url
 
 
 logger = logging.getLogger(__name__)
@@ -79,3 +80,7 @@ def _fix_item(self, item):
         for field in fields:
             if field.lower().startswith("x-"):
                 item["data"].pop(field)
+
+        # Remove credentials from URL
+        item['origin'] = anonymize_url(item['origin'])
+        item['tag'] = anonymize_url(item['tag'])
diff --git a/releases/unreleased/mbox-origin-url-anonymized.yml b/releases/unreleased/mbox-origin-url-anonymized.yml
@@ -0,0 +1,7 @@
+---
+title: MBOX origin URL anonymized
+category: fixed
+author: Jose Javier Merchante <[email protected]>
+issue: null
+notes: >
+  Remove credentials from MBOX origin URL and tag fields.