Split .kibana system index into multiple indices

[gsoldevila]

Part of #104081
Depends on #154151

First attempt is to move all 'cases*' saved objects into a separate .kibana_cases index.
esArchiver (along with all FTR that use it) has proven a worthy enemy of this initiative, as it relies on the fact that there are only two system indices: .kibana and .kibana_task_manager.

[pgayvallet]

There's no unit tests for this mergeMigrationMappingPropertyHashes helper. We should add some (and assert the behavior of this change/fix)

Should this be done in the current PR or on the 'upstream' one?

[gsoldevila]

We should do it on the upstream PR.

But first I wanted to check whether this mergeMigrationMappingPropertyHashes operation is still necessary.
If we want to use these hashes as a basis to construct the indexTypesMap, I'm afraid the merge can be problematic. @rudolf WDYT?

[rudolf]

We use these in checkTargetMappings as a way to determine if mappings are up to date. If we don't merge the _meta it means there could be plugins which have applied some mappings that we don't know about. This would cause us to go to UPDATE_TARGET_MAPPINGS_PROPERTIES which would be unecessary but not a problem. So I don't see an obvious problem right now.

[kibana-ci]

💛 Build succeeded, but was flaky

• Buildkite Build
• Commit: d0bb843

Failed CI Steps

• Build Kibana Distribution and Plugins
• FTR Configs #41

Test Failures

• [job] [logs] FTR Configs #41 / machine learning - short tests Notifcations Notifications list supports custom sorting for notifications level

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
@kbn/core-saved-objects-migration-server-internal	85	87	+2
@kbn/core-saved-objects-server	99	101	+2
total			+4

Public APIs missing exports

Total count of every type that is part of your API that should be exported but is not. This will cause broken links in the API documentation system. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats exports for more detailed information.

id	before	after	diff
@kbn/core-saved-objects-base-server-internal	8	9	+1

Saved Objects .kibana field count

Every field in each saved object type adds overhead to Elasticsearch. Kibana needs to keep the total field count below Elasticsearch's default limit of 1000 fields. Only specify field mappings for the fields you wish to search on or query. See https://www.elastic.co/guide/en/kibana/master/saved-objects-service.html#_mappings

id	before	after	diff
cases	50	-	-50
cases-comments	14	-	-14
cases-configure	4	-	-4
cases-connector-mappings	2	-	-2
cases-user-actions	16	-	-16
total			-86

Unknown metric groups

API count

id	before	after	diff
@kbn/core-saved-objects-migration-server-internal	120	122	+2
@kbn/core-saved-objects-server	493	496	+3
total			+5

ESLint disabled line counts

id	before	after	diff
securitySolution	433	436	+3

Total ESLint disabled count

id	before	after	diff
securitySolution	512	515	+3

History

• 💔 Build #119277 failed 342c400
• 💔 Build #119181 failed 288c4b4
• 💔 Build #119116 failed ce58e44
• 💔 Build #118947 failed 2046c27
• 💔 Build #118896 failed 6483764

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[gsoldevila]

Replaced by #154888