Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add static mapping for dynamodb metricset #17614

Merged
merged 2 commits into from
Apr 14, 2020

Conversation

ChrsMark
Copy link
Member

@ChrsMark ChrsMark commented Apr 8, 2020

What does this PR do?

This PR adds static mappings for aws dynamodb metricset.

Why is it important?

To avoid having breaking non TSVB visualisations when there no data in ES to create the respective fields with the dynamic mapping.

@ChrsMark ChrsMark added bug Team:Platforms Label for the Integrations - Platforms team labels Apr 8, 2020
@ChrsMark ChrsMark requested a review from kaiyan-sheng April 8, 2020 15:16
@ChrsMark ChrsMark self-assigned this Apr 8, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@ChrsMark ChrsMark changed the title Add static mapping for dynamodb metricset Add static mapping for dynamodb metricset and dashboard improvements Apr 9, 2020
@ChrsMark ChrsMark requested a review from jsoriano April 9, 2020 09:31
@ChrsMark
Copy link
Member Author

ChrsMark commented Apr 9, 2020

@jsoriano I added dashboard changes in this PR, feel free to comment!

@jsoriano
Copy link
Member

jsoriano commented Apr 9, 2020

Thanks!

Some suggestions on the dashboard:

  • ECS suffix is not needed in dashboards created after 7.0, this was added to dashboards that existed before the migration to ECS.
  • Titles of visualizations can be edited after placing them on dashboards, so you can remove the [Metricbeat AWS] part from there.

@ChrsMark ChrsMark force-pushed the mapping_aws_dynamodb branch from 691dbc8 to bb65cc6 Compare April 9, 2020 11:26
@ChrsMark ChrsMark force-pushed the mapping_aws_dynamodb branch from bb65cc6 to e4151dc Compare April 9, 2020 11:27
@ChrsMark ChrsMark changed the title Add static mapping for dynamodb metricset and dashboard improvements Add static mapping for dynamodb metricset Apr 9, 2020
@ChrsMark
Copy link
Member Author

ChrsMark commented Apr 9, 2020

@jsoriano I moved the dashboard (latest suggestions included) part in separate PR #17633 to rush it for 7.7. Sorry for travelling this around 🙂 .

@kaiyan-sheng
Copy link
Contributor

Tested and it works! Thanks for the help!

Copy link
Contributor

@kaiyan-sheng kaiyan-sheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One question about type here: should we use double instead of long for some of the metrics?

Streams during the specified time period.
fields:
- name: avg
type: long
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should some of these metrics be double type? For example, in data.json aws.dynamodb.metrics.SuccessfulRequestLatency.avg = 1.6592021822660081

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, I think that most of the metrics here should be double.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😬 nice catch, thank you both!

Signed-off-by: chrismark <[email protected]>
Copy link
Contributor

@kaiyan-sheng kaiyan-sheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

ChrsMark added a commit to ChrsMark/beats that referenced this pull request Apr 14, 2020
* Add static mapping for dynamodb metricset

Signed-off-by: chrismark <[email protected]>

* Fix field types

Signed-off-by: chrismark <[email protected]>
(cherry picked from commit e023845)
ChrsMark added a commit to ChrsMark/beats that referenced this pull request Apr 14, 2020
* Add static mapping for dynamodb metricset

Signed-off-by: chrismark <[email protected]>

* Fix field types

Signed-off-by: chrismark <[email protected]>
(cherry picked from commit e023845)
kaiyan-sheng added a commit that referenced this pull request Apr 29, 2020
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Team:Platforms Label for the Integrations - Platforms team v7.7.0 v7.8.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants