feat(slo): introduce new search capabilities

[kdelemme]

Summary

This PR merges the new summary search capabilities into main.

This PR introduces breaking changes in various places, and we have decided to not handle backward compatibility:

• SLO find API body parameters have changed
• The index mapping used by the rollup data has changed, and we have added a summary index that becomes the new source of truth for search
• The rollup transform have been updated, but existing SLO with their transform won't be updated.

If some SLOs have been installed in a prior version at 8.10, the user will need to remove them manually from the UI, or by deleting the Saved Object and the associated Transform.

In a nutshell, we have added another layer of transforms to summarize each SLO so we can use this data in the find API and therefore in the listing page. Because of the inherent delay of the transform, the summary data is not available right after creating or updating an SLO. To mitigate this, we index a temporary summary document with "no_data values for the given SLO, and when we search the summary documents, we dedupe the temporary vs non temporary summary documents, and delete them in the brackground. Therefore the summary documents are eventually consistent as we read through them.

flowchart LR
    A(Raw Data Index) --> B[Rollup Transform]
    B --> C(Rollup Data Index)
    C --> D[Summary Transform]
    D --> E(Summary Data Index)

Loading

Release note

SLO definition and computed values are now summarized periodically into a summary search index, allowing users to search by name, tags, SLO budgeting type or time window, and even by and sort by error budget consumed, error budget remaining, SLI value or status. This is a breaking change due to the changes in the transform definitions. To mitigate this change, you will need to re-create your SLOs by exporting the definitions via the listing API.

[apmmachine]

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

• /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
• /oblt-deploy-serverless : Deploy a serverless Kibana instance using the Observability test environments.
• run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

[elasticmachine]

Pinging @elastic/actionable-observability (Team: Actionable Observability)

[kibana-ci]

💛 Build succeeded, but was flaky

• Buildkite Build
• Commit: 6f0443f
• Storybooks Preview

Failed CI Steps

• x-pack/test/alerting_api_integration/security_and_spaces/group2/config_non_dedicated_task_runner.ts

Test Failures

• [job] [logs] x-pack/test/alerting_api_integration/security_and_spaces/group2/config_non_dedicated_task_runner.ts / alerting api integration security and spaces enabled - Group 2 Connectors ServiceNow SIR ServiceNow SIR - Action Creation should return 200 when creating a servicenow Basic Auth connector successfully

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
observability	1.0MB	1.0MB	-961.0B

History

• 💚 Build #145541 succeeded 533a6f2f515dccdef124b4d161e2af7d097f0ce9
• 💔 Build #145376 failed 979cac6
• 💔 Build #145341 failed 3c87279

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[simianhacker]

LGTM