Skip to content
This repository has been archived by the owner on Nov 23, 2023. It is now read-only.

Cloudwatch log group should expire after a set amount of time time in CI #2240

Open
2 tasks
Jimlinz opened this issue Nov 1, 2022 · 2 comments
Open
2 tasks
Labels
enabler story Enable to team to improve

Comments

@Jimlinz
Copy link
Contributor

Jimlinz commented Nov 1, 2022

Enabler

So that CI logs are searchable, we want to expire Cloudwatch logs after a [group agreed] set amount of time. Logs created by CI are currently set to never expire. This adds up overtime, making searching difficult (AWS only loads up to 10,000 log groups by default). More logs will be created as the product grows, which will also incur additional costs to keep them forever.

Acceptance Criteria

  • Logs expire after X amount of time
  • Most recent logs (~ last 3 weeks) are easily searchable via Cloudwatch (AWS Console)
@Jimlinz Jimlinz added the enabler story Enable to team to improve label Nov 1, 2022
@billgeo
Copy link
Contributor

billgeo commented Nov 1, 2022

What about ElasticSearch? Do we need logs stored at all?

@Jimlinz
Copy link
Contributor Author

Jimlinz commented Nov 1, 2022

Logs going to ElasticSearch is managed here (I think):
https://github.com/linz/elasticsearch-config/tree/master/config/li/ilm

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enabler story Enable to team to improve
Development

No branches or pull requests

2 participants