Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution][Detections] ML Rules configured with incorrect ML Job ID #102146

Closed
spong opened this issue Jun 14, 2021 · 5 comments · Fixed by elastic/detection-rules#1287
Closed
Assignees
Labels
bug Fixes for quality problems that affect the customer experience Feature:Detection Rules Security Solution rules and Detection Engine Feature:ML Rule Security Solution Machine Learning rule type Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.

Comments

@spong
Copy link
Member

spong commented Jun 14, 2021

When the 7.13 rules were added (#98975), there were four ML Rules that ended up with incorrectly configured ML Job ID's, using -'s instead of _'s. As a result, when enabled the rule will fail to execute and display the following error message:

An error occurred during rule execution: message: "rare-destination-country missing" name: "Network Traffic to Rare Destination Country" id: "ab5b9612-cd61-11eb-b57c-fbc45cd7b06b" rule id: "35f86980-1fb1-4dff-b311-3be941549c8d" signals index: ".siem-signals-spong-default"

Workaround is to duplicate the rule (since pre-packaged rules cannot be edited), and to select the correct ML Job ID.

The Rules affected include:

"machine_learning_job_id": "high-count-by-destination-country" (Kibana Rule)
"machine_learning_job_id": "high-count-network-denies" (Kibana Rule)
"machine_learning_job_id": "high-count-network-events" (Kibana Rule)
"machine_learning_job_id": "rare-destination-country" (Kibana Rule)

Rule enabled showing error message, incorrect ML Job text, and correct job text from ML Job Settings UI:

Detections_-_Kibana

(Note how the ML Job text is not a link and does not have a Started/Stopped badge next to it.)

cc @randomuserid

@spong spong added bug Fixes for quality problems that affect the customer experience Feature:Detection Rules Security Solution rules and Detection Engine Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Feature:ML Rule Security Solution Machine Learning rule type labels Jun 14, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@rw-access
Copy link
Contributor

@spong are you okay if I move this issue to detection-rules and we fix it there?

@spong
Copy link
Member Author

spong commented Jun 15, 2021

@spong are you okay if I move this issue to detection-rules and we fix it there?

So long as we still have a Kibana issue open for tracking them making it into the kibana pre-packaged rules that's okay with me. 👍

@spong
Copy link
Member Author

spong commented Jun 29, 2021

Resolved in 7.13.3 as of #103695

And resolved in 7.14 as of #101846

@spong spong closed this as completed Jun 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience Feature:Detection Rules Security Solution rules and Detection Engine Feature:ML Rule Security Solution Machine Learning rule type Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants