Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dataset quality] Enable page for metrics and traces #190043

Conversation

yngrdyn
Copy link
Contributor

@yngrdyn yngrdyn commented Aug 7, 2024

Closes https://github.com/elastic/observability-dev/issues/3454.

This PR enables Dataset quality for being used for traces and metrics.

Changes

  • Added KNOWN_TYPES array containing the types that we allow in dataset quality page.
  • datasets, degradedDocs and nonAggregatableDatasets are now wrapped in an state. This allow us to retrigger the calls whenever we need to do it (e.g. when changing timeframe), more importantly now whenever we select a new type of dataset.
  • The invoke degradedDocs is created dynamically depending on the types present in KNOWN_TYPES.
  • GET /internal/dataset_quality/data_streams/stats and GET /internal/dataset_quality/data_streams/non_aggregatable now accept an array of DataStreamType. This allow us to query the information for multiple types of dataStreams at the same time.
  • degradedDocs are stored now locally as a nested structure. This nested structure allow us to update just the needed portion instead of updating all datasets whenever a change occurs (e.g. a type is deselected).
  • redirectLink now takes into account the datastream type, it only redirects to logs explorer if it's enabled and the type of the datastream is logs.

🎥 Demo

Screen.Recording.2024-08-20.at.14.10.15.mov

@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 7, 2024

/ci

@obltmachine
Copy link

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 7, 2024

/ci

@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 8, 2024

/ci

@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 8, 2024

/ci

@yngrdyn yngrdyn force-pushed the 3454-dataset-quality-enable-pages-for-metrics-and-traces branch from 424ef39 to 3f9fb63 Compare August 19, 2024 12:32
@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 19, 2024

/ci

@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 19, 2024

/ci

@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 19, 2024

/ci

@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 20, 2024

/ci

@yngrdyn
Copy link
Contributor Author

yngrdyn commented Aug 20, 2024

/ci

@yngrdyn yngrdyn marked this pull request as ready for review August 20, 2024 10:59
@yngrdyn yngrdyn requested a review from a team as a code owner August 20, 2024 10:59
@yngrdyn yngrdyn added the release_note:feature Makes this part of the condensed release notes label Aug 20, 2024
@yngrdyn yngrdyn force-pushed the 3454-dataset-quality-enable-pages-for-metrics-and-traces branch 2 times, most recently from b4a7e37 to 1a6a1d0 Compare August 22, 2024 10:45
@yngrdyn yngrdyn force-pushed the 3454-dataset-quality-enable-pages-for-metrics-and-traces branch from 1a6a1d0 to ae42b56 Compare August 22, 2024 10:47
Copy link
Contributor

@achyutjhunjhunwala achyutjhunjhunwala left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes LGTM 👍🏼

…s' of github.com:yngrdyn/kibana into 3454-dataset-quality-enable-pages-for-metrics-and-traces
@yngrdyn yngrdyn force-pushed the 3454-dataset-quality-enable-pages-for-metrics-and-traces branch 3 times, most recently from a6de1be to 4d346f5 Compare August 23, 2024 09:32
@yngrdyn yngrdyn force-pushed the 3454-dataset-quality-enable-pages-for-metrics-and-traces branch from 11242d5 to 17fa51c Compare August 23, 2024 09:59
@kibana-ci
Copy link
Collaborator

kibana-ci commented Aug 27, 2024

💚 Build Succeeded

  • Buildkite Build
  • Commit: 21d53e6
  • Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-190043-21d53e64dca4

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
datasetQuality 293 295 +2

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
datasetQuality 287.0KB 289.9KB +2.9KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
dataQuality 7.9KB 7.9KB +24.0B
datasetQuality 49.0KB 49.2KB +229.0B
total +253.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@yngrdyn yngrdyn merged commit 2441e9a into elastic:main Aug 27, 2024
22 checks passed
@kibanamachine kibanamachine added v8.16.0 backport:skip This commit does not require backporting labels Aug 27, 2024
yngrdyn added a commit that referenced this pull request Sep 2, 2024
…taset when no type is selected in the UI (#191895)

In #190043 we enabled `GET
/internal/dataset_quality/data_streams/stats` and `GET
/internal/dataset_quality/data_streams/non_aggregatable` for work with
multiple dataStream types, but we left out the case where in the UI no
type is selected.

The solution is the same we applied to [`GET
/internal/dataset_quality/data_streams/stats`](https://github.com/yngrdyn/kibana/blob/b1f9e290213368e550ab692124a419683409c937/x-pack/plugins/observability_solution/dataset_quality/public/services/data_streams_stats/data_streams_stats_client.ts#L38),
when no type is selected in the UI we should send all known types.

### Before


https://github.com/user-attachments/assets/da83c3c2-6d6d-4401-bd12-99d6ab1da7ea

### After


https://github.com/user-attachments/assets/cf17594f-d4a9-4d83-8a9a-6252e102b475
@gbamparop gbamparop added the Team:obs-ux-logs Observability Logs User Experience Team label Oct 1, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-logs-team (Team:obs-ux-logs)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting ci:project-deploy-observability Create an Observability project release_note:feature Makes this part of the condensed release notes Team:obs-ux-logs Observability Logs User Experience Team v8.16.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants