Skip to content

Commit

Permalink
[Filebeat] Threatintel compatibility updates (elastic#27323)
Browse files Browse the repository at this point in the history
* First pass on updating filebeat threatintel logic for ECS 1.11

This only covers modules starting with an a; the rest will follow
shortly. In general, these changes address the following goals:

* preference for indicator.url.domain, and deprecation of
  indicator.domain
* moving from event.reference to indicator.reference

* Move remaining modules from indicator.domain -> indicator.url.domain

Along with conditional checks to ensure we're not overwriting the
relevant uri_parts data from earlier in the pipeline.

* Update indicator.reference in relevant modules

* Fix missing prefix in target field

* linting and apply new testfiles

* Run `make update` in filebeat

* fixing duplicate fields

* mage fmt update

* linting

Co-authored-by: Marius Iversen <[email protected]>
  • Loading branch information
2 people authored and wiwen committed Nov 1, 2021
1 parent e17cb69 commit 1806da0
Show file tree
Hide file tree
Showing 23 changed files with 2,299 additions and 2,087 deletions.
12 changes: 6 additions & 6 deletions filebeat/docs/fields.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -156557,23 +156557,23 @@ type: keyword

--

*`threatintel.indicator.ip`*::
*`threatintel.indicator.reference`*::
+
--
Identifies a threat indicator as an IP address (irrespective of direction).
Reference URL linking to additional information about this indicator.


type: ip
type: keyword

--

*`threatintel.indicator.domain`*::
*`threatintel.indicator.ip`*::
+
--
Identifies a threat indicator as a domain (irrespective of direction).
Identifies a threat indicator as an IP address (irrespective of direction).


type: keyword
type: ip

--

Expand Down
4 changes: 2 additions & 2 deletions filebeat/docs/modules/threatintel.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ Abuse.ch URL Threat Intel is mapped to the following ECS fields.
[options="header"]
|==============================================================
| URL Threat Intel Fields | ECS Fields
| url | threat.indicator.url.full
| url | threatintel.indicator.url.full
| date_added | @timestamp
| host | threatintel.indicator.ip/domain
|==============================================================
Expand Down Expand Up @@ -473,7 +473,7 @@ Anomali ThreatStream fields are mapped to the following ECS fields:
| date_first | threatintel.indicator.first_seen
| date_last | threatintel.indicator.last_seen
| detail | tags
| domain | threatintel.indicator.domain
| domain | threatintel.indicator.url.domain
| email | threatintel.indicator.email.address
| itype<<a,[1]>> | threatintel.indicator.type
| lat | threatintel.indicator.geo.location.lat
Expand Down
4 changes: 2 additions & 2 deletions x-pack/filebeat/module/threatintel/_meta/docs.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ Abuse.ch URL Threat Intel is mapped to the following ECS fields.
[options="header"]
|==============================================================
| URL Threat Intel Fields | ECS Fields
| url | threat.indicator.url.full
| url | threatintel.indicator.url.full
| date_added | @timestamp
| host | threatintel.indicator.ip/domain
|==============================================================
Expand Down Expand Up @@ -468,7 +468,7 @@ Anomali ThreatStream fields are mapped to the following ECS fields:
| date_first | threatintel.indicator.first_seen
| date_last | threatintel.indicator.last_seen
| detail | tags
| domain | threatintel.indicator.domain
| domain | threatintel.indicator.url.domain
| email | threatintel.indicator.email.address
| itype<<a,[1]>> | threatintel.indicator.type
| lat | threatintel.indicator.geo.location.lat
Expand Down
Loading

0 comments on commit 1806da0

Please sign in to comment.