Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dataset quality] Adding size column and estimated size to serverless #193998

Conversation

yngrdyn
Copy link
Contributor

@yngrdyn yngrdyn commented Sep 25, 2024

Closes https://github.com/elastic/logs-dev/issues/179.

This PR aims to enable:
The estimated size is displayed in Serverless in the following areas:

  • Estimated and size column in main page
  • Size in Overview section of Dataset details

Demo

Screen.Recording.2024-09-25.at.15.12.41.mov

@yngrdyn yngrdyn requested a review from a team as a code owner September 25, 2024 13:16
@botelastic botelastic bot added the ci:project-deploy-observability Create an Observability project label Sep 25, 2024
@obltmachine
Copy link

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@yngrdyn yngrdyn added release_note:skip Skip the PR/issue when compiling release notes backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) labels Sep 25, 2024
@mohamedhamed-ahmed
Copy link
Contributor

I remember there were a couple of checks on the UI as well, do we need to clean them up ?
IIRC in the statemachine and the columns file, probably in the flyout as well

@@ -26,10 +26,9 @@ export const useOverviewSummaryPanel = () => {
.map((key: string) => services[key].length)
.reduce((a, b) => a + b, 0);

const totalDocsCount = formatNumber(dataStreamDetails?.docsCount ?? 0, NUMBER_FORMAT);
const totalDocsCount = formatNumber(dataStreamDetails.docsCount, NUMBER_FORMAT);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

qq: could it happen that docsCount be undefined? I can see this in the type definition but not sure if this is possible. In this case the formatNumber function returns an empty string, is this what we want to display on the UI?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

According to this line docsCount will always be a number, in the worst case scenario (no documents) it will be 0.

Copy link
Contributor

@mohamedhamed-ahmed mohamedhamed-ahmed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!! Thanks for cleaning up the code

@kibana-ci
Copy link
Collaborator

kibana-ci commented Sep 30, 2024

💛 Build succeeded, but was flaky

  • Buildkite Build
  • Commit: 2025677
  • Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-193998-2025677330f4

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #14 / Serverless observability API Dataset Quality gets the data stream details returns "sizeBytes" correctly

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
datasetQuality 208.5KB 208.0KB -527.0B

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
datasetQuality 49.7KB 49.7KB -54.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@yngrdyn yngrdyn merged commit ea98506 into elastic:main Oct 1, 2024
26 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.x

https://github.com/elastic/kibana/actions/runs/11121121947

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Oct 1, 2024
…elastic#193998)

Closes elastic/logs-dev#179.

This PR aims to enable:
The estimated size is displayed in Serverless in the following areas:
- Estimated and size column in main page
- Size in Overview section of Dataset details

### Demo

https://github.com/user-attachments/assets/b0ef03fb-061d-44e5-8e1a-c47ece58de37
(cherry picked from commit ea98506)
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Oct 1, 2024
…erless (#193998) (#194520)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[Dataset quality] Adding size column and estimated size to serverless
(#193998)](#193998)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Yngrid
Coello","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-10-01T08:01:22Z","message":"[Dataset
quality] Adding size column and estimated size to serverless
(#193998)\n\nCloses
https://github.com/elastic/logs-dev/issues/179.\r\n\r\nThis PR aims to
enable:\r\nThe estimated size is displayed in Serverless in the
following areas:\r\n- Estimated and size column in main page\r\n- Size
in Overview section of Dataset details\r\n\r\n###
Demo\r\n\r\nhttps://github.com/user-attachments/assets/b0ef03fb-061d-44e5-8e1a-c47ece58de37","sha":"ea9850683a2b24ede2b792717eb6c2ed9271777d","branchLabelMapping":{"^v9.0.0$":"main","^v8.16.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","ci:project-deploy-observability"],"title":"[Dataset
quality] Adding size column and estimated size to
serverless","number":193998,"url":"https://github.com/elastic/kibana/pull/193998","mergeCommit":{"message":"[Dataset
quality] Adding size column and estimated size to serverless
(#193998)\n\nCloses
https://github.com/elastic/logs-dev/issues/179.\r\n\r\nThis PR aims to
enable:\r\nThe estimated size is displayed in Serverless in the
following areas:\r\n- Estimated and size column in main page\r\n- Size
in Overview section of Dataset details\r\n\r\n###
Demo\r\n\r\nhttps://github.com/user-attachments/assets/b0ef03fb-061d-44e5-8e1a-c47ece58de37","sha":"ea9850683a2b24ede2b792717eb6c2ed9271777d"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/193998","number":193998,"mergeCommit":{"message":"[Dataset
quality] Adding size column and estimated size to serverless
(#193998)\n\nCloses
https://github.com/elastic/logs-dev/issues/179.\r\n\r\nThis PR aims to
enable:\r\nThe estimated size is displayed in Serverless in the
following areas:\r\n- Estimated and size column in main page\r\n- Size
in Overview section of Dataset details\r\n\r\n###
Demo\r\n\r\nhttps://github.com/user-attachments/assets/b0ef03fb-061d-44e5-8e1a-c47ece58de37","sha":"ea9850683a2b24ede2b792717eb6c2ed9271777d"}}]}]
BACKPORT-->

Co-authored-by: Yngrid Coello <[email protected]>
@gbamparop gbamparop added the Team:obs-ux-logs Observability Logs User Experience Team label Oct 1, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-logs-team (Team:obs-ux-logs)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) ci:project-deploy-observability Create an Observability project release_note:skip Skip the PR/issue when compiling release notes Team:obs-ux-logs Observability Logs User Experience Team v8.16.0 v9.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants