Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nd 485 smtp metric #290

Merged
merged 3 commits into from
Sep 25, 2024
Merged

Nd 485 smtp metric #290

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
d2d86a4
added failed to scrape metric to be pulled in to grafana
juddin927 Sep 12, 2024
83dffc0
added postfix exporter failed to scrape metric alerting rules
juddin927 Sep 24, 2024
60a099c
added SMTP production alerting route to Critical slack channel for cr…
juddin927 Sep 24, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions k8s-helm-charts/cns-team-monitoring/templates/alertmanager-primary-alertmanagerconfig.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -107,6 +107,14 @@ spec:
value: NACS Certificate Expiry Warning
- name: severity
value: warning
- receiver: NVVS DevOps Critical
groupWait: 10s
repeatInterval: 7d
matchers:
- name: service
value: SMTP Relay
- name: severity
value: critical

receivers:
- name: Master Route
Expand Down
15 changes: 15 additions & 0 deletions ...lm-charts/cns-team-monitoring/templates/cloudwatch-metrics/_production-metrics-custom.tpl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -449,6 +449,21 @@
nilToZero: true
period: 300
length: 300
- namespace: smtp-relay-postfix-exporter
name: "smtp-relay-postfix-exporter"
regions: [eu-west-2]
roles:
- roleArn: {{ .Values.cloudwatchExporterProductionArn }}
- roleArn: {{ .Values.cloudwatchExporterPreProductionArn }}
- roleArn: {{ .Values.cloudwatchExporterDevelopmentArn }}
- roleArn: {{ .Values.cloudwatchExporterPkiArn }}
metrics:
- name: "FailedToScrape"
statistics: [Sum]
nilToZero: true
period: 300
length: 300

- namespace: GP_GATEWAY_VMseries
name: "GP_GATEWAY_VMseries"
regions: [eu-west-2]
Expand Down
11 changes: 11 additions & 0 deletions k8s-helm-charts/cns-team-monitoring/templates/smtp-relay-alert-rules.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,3 +65,14 @@ spec:
summary: SMTP Rate of change in deferred status count is above 0.0200
description: The SMTP deferred rate of change has increased above 0.0200
grafana_dashboard_url: https://monitoring-alerting.staff.service.justice.gov.uk/d/h36Havfik/postfix
- alert: SMTP Postfix Exporter Failed to Scrape Metric
expr: aws_smtp_relay_postfix_exporter_failed_to_scrape_sum{account_id="{{ .Values.production_account_id }}" } > 1
for: 5m
labels:
severity: critical
service: SMTP Relay
namespace: {{ .Release.Namespace }}
annotations:
summary: SMTP Postfix Exporter has failed to Scrape logs from SMTP Server
description: The SMTP Postfix Exporter FailedToScrape Metric SUM is > 1
grafana_dashboard_url: https://monitoring-alerting.staff.service.justice.gov.uk/d/h36Havfik/postfix
Loading