Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[O11y][Hadoop] Migrate node_manager and data_node dashboards visualizations to lens in kibana 8.3.0 #5605

Conversation

harnish-elastic
Copy link
Contributor

@harnish-elastic harnish-elastic commented Mar 21, 2023

  • Enhancement

What does this PR do?

  • Migrate visualizations to lens for Hadoop integration package

  • Statistics for Hadoop Lens migration:

Hadoop dashboards Before Migration   After Migration  
  Lens Visualization Lens Visualization
[Metrics Hadoop] Data nodes 6 3 9 0
[Metrics Hadoop] Node Manager 0 3 3 0
  6 6 12 0

Checklist

  • I have added an entry to my package's changelog.yml file.
  • I have verified that panels are populated with data.
  • I have verified that panels are not distorted after being migrated to lens.
  • I have updated screenshots of dashboard.
  • I have verified that data count are matching and panel aggregations are same as before.

Author's checklist

  • Migrated panels should be removed from visualization folder.
  • Migrated visualizations are populating in current Kibana version 8.3.0.

Related issues

@elasticmachine
Copy link

elasticmachine commented Mar 21, 2023

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2023-03-21T13:04:44.519+0000

  • Duration: 21 min 32 sec

Test stats 🧪

Test Results
Failed 0
Passed 46
Skipped 0
Total 46

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@elasticmachine
Copy link

elasticmachine commented Mar 21, 2023

🌐 Coverage report

Name Metrics % (covered/total) Diff
Packages 100.0% (5/5) 💚
Files 100.0% (9/9) 💚
Classes 100.0% (9/9) 💚
Methods 100.0% (47/47) 💚 10.909
Lines 99.18% (605/610) 👍 9.922
Conditionals 100.0% (0/0) 💚

Copy link
Collaborator

@kush-elastic kush-elastic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@@ -1,4 +1,9 @@
# newer versions go on top
- version: "0.5.0"
changes:
- description: Migrate `[Metrics Hadoop] Data nodes` and `[Metrics Hadoop] Node Manager` dashboard visualizations to lens.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is not needed to add [Metric Hadoop] string in the changelog

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated, thanks!

@agithomas
Copy link
Contributor

image

I assume, the panel at the top is the time duration it takes .
In the panel below, does the "Duration" text in the "Container Launch Duration (Num of operation) " make sense? Please change from Num of operation to Operation Count.

@harnish-elastic
Copy link
Contributor Author

image

I assume, the panel at the top is the time duration it takes . In the panel below, does the "Duration" text in the "Container Launch Duration (Num of operation) " make sense? Please change from Num of operation to Operation Count.

This name is already there in the current codebase. This is just the lens migration PR so we won't be changing any behavior as a part of this PR otherwise it will mess it up. However, If you strongly feel that this change needs to be done then we can raise a separate issue for that and track them separately.

@agithomas
Copy link
Contributor

This name is already there in the current codebase. This is just the lens migration PR so we won't be changing any behavior as a part of this PR otherwise it will mess it up. However, If you strongly feel that this change needs to be done then we can raise a separate issue for that and track them separately.

As you think that the change will complicate the PR, continue with the same scope.

Copy link
Contributor

@agithomas agithomas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kush-elastic kush-elastic merged commit 28f8ec3 into elastic:main Mar 28, 2023
@elasticmachine
Copy link

Package hadoop - 0.5.0 containing this change is available at https://epr.elastic.co/search?package=hadoop

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Integration:hadoop Hadoop Team:Service-Integrations Label for the Service Integrations team v8.3.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants