Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RDS increase log retention period #3324

Closed
2 tasks
BrianEllwood opened this issue Feb 15, 2024 · 5 comments
Closed
2 tasks

RDS increase log retention period #3324

BrianEllwood opened this issue Feb 15, 2024 · 5 comments
Assignees
Labels
data-platform-apps-and-tools This issue is owned by Data Platform Apps and Tools stale

Comments

@BrianEllwood
Copy link
Contributor

BrianEllwood commented Feb 15, 2024

User Story
As an AP engineer, I would like to retain RDS logs for 6 months to aid with investigating issues

Value / Purpose
Whilst investigating issue 3193 it was found that logs were not retained log enough to aid investigation increasing the retention period would help with any future investigation.

User Types
AP Engineers

Proposal
Review current RDS log retention and increase where possible (how?)

DOD

  • Current retention period investigated
  • Where possible increase retention period to 6 months
@BrianEllwood BrianEllwood converted this from a draft issue Feb 15, 2024
@BrianEllwood BrianEllwood added the data-platform-apps-and-tools This issue is owned by Data Platform Apps and Tools label Feb 15, 2024
@jacobwoffenden jacobwoffenden moved this to 👀 TODO in Analytical Platform Feb 15, 2024
@BrianEllwood BrianEllwood moved this from 👀 TODO to 🚀 In Progress in Analytical Platform Mar 25, 2024
@BrianEllwood BrianEllwood self-assigned this Mar 25, 2024
@BrianEllwood
Copy link
Contributor Author

BrianEllwood commented Mar 27, 2024

So while investigating how to increase log retention period I was checking via the console in cloudwatch where the furthest back you can see in the alarm metrics is two weeks. if I access monitoring via RDS the same metric can be seen for 12 months, though if you try to view full screen it drops back to two weeks ? Another quirk enlarge allows to increase the plot size and see 12 months.

"Metric data is kept for 15 months, enabling you to view both up-to-the-minute data and historical data" from AWS documentation.

@BrianEllwood
Copy link
Contributor Author

When we had issue 3324 we could not look at the metrics in CloudWatch as the metrics were only available for a short period, I have since found that this information is available via the RDS console for 15 months.
Unfortunately the RDS error logs are only retained for 3 days, which is the default. We could increase the rds.log_retention_period but this could cause issues with spaces on the RDS instance and has a maximum retention period of 7 days which would not have helped the previous investigation.

Alternatively we can store our PostgreSQL log records in Amazon CloudWatch Logs

@BrianEllwood
Copy link
Contributor Author

Resolving issues raised by checkov/trivy

@BrianEllwood
Copy link
Contributor Author

decision made that this work not required as RDS will be looked at in next version of control panel.

Copy link
Contributor

github-actions bot commented Jun 2, 2024

This issue is being marked as stale because it has been open for 60 days with no activity. Remove stale label or comment to keep the issue open.

@github-actions github-actions bot added the stale label Jun 2, 2024
@jacobwoffenden jacobwoffenden closed this as not planned Won't fix, can't repro, duplicate, stale Jun 4, 2024
@github-project-automation github-project-automation bot moved this from 🚀 In Progress to 🎉 Done in Analytical Platform Jun 4, 2024
@jacobwoffenden jacobwoffenden moved this from 🎉 Done to 👀 TODO in Analytical Platform Jun 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data-platform-apps-and-tools This issue is owned by Data Platform Apps and Tools stale
Projects
Archived in project
Development

No branches or pull requests

2 participants