Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend Etcd CRD and etcd-druid to Support Configurable Delta Snapshot Retention #651

Conversation

seshachalam-yv
Copy link
Contributor

@seshachalam-yv seshachalam-yv commented Jul 29, 2023

How to categorize this PR?
/area backup
/kind api-change

What this PR does / why we need it:
This PR extends the Etcd CRD to include a DeltaSnapshotRetentionPeriod field. This new field allows users to define the duration for retaining old delta snapshots, providing more flexibility in managing backup retention. Additionally, this PR modifies etcd-druid to propagate the --delta-snapshot-retention-period flag from the Etcd CRD to the etcd-backup-restore component.

This change allows the etcd-backup-restore to have access to the DeltaSnapshotRetentionPeriod configuration which was not previously propagated. As such, it provides greater flexibility in the configuration of backup parameters.

Which issue(s) this PR fixes:
Fixes #649

Special notes for your reviewer:

Release note:

Introduce `Spec.Backup.DeltaSnapshotRetentionPeriod` in the `Etcd` resource to allow configuring retention period for delta snapshots.

@seshachalam-yv seshachalam-yv requested a review from a team as a code owner July 29, 2023 14:49
@gardener-robot gardener-robot added area/backup Backup related kind/api-change API change with impact on API users needs/review Needs review size/xs Size of pull request is tiny (see gardener-robot robot/bots/size.py) labels Jul 29, 2023
@gardener-robot-ci-1 gardener-robot-ci-1 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) needs/ok-to-test Needs approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Jul 29, 2023
@seshachalam-yv seshachalam-yv force-pushed the feature/add-delta-snapshot-retention-period branch from 524e4e9 to 00b2df5 Compare July 29, 2023 15:57
@gardener-robot-ci-1 gardener-robot-ci-1 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Jul 29, 2023
Copy link
Contributor

@shreyas-s-rao shreyas-s-rao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@seshachalam-yv thanks for the PR. While the PR adds the new field to the Etcd CR, druid does not use the value anywhere. Please ensure that druid creates the etcd statefulset with this field's value correctly passed to the etcdbrctl command.

@gardener-robot gardener-robot added the needs/changes Needs (more) changes label Jul 31, 2023
@ashwani2k ashwani2k requested a review from aaronfern July 31, 2023 10:14
@aaronfern
Copy link
Contributor

/retest

@aaronfern
Copy link
Contributor

/test pull-etcd-druid-e2e-kind-alpha-features

@gardener-robot
Copy link

@aaronfern You have pull request review open invite, please check

@seshachalam-yv seshachalam-yv force-pushed the feature/add-delta-snapshot-retention-period branch from 00b2df5 to da9d680 Compare August 3, 2023 11:15
@gardener-robot gardener-robot added size/m Size of pull request is medium (see gardener-robot robot/bots/size.py) and removed size/xs Size of pull request is tiny (see gardener-robot robot/bots/size.py) labels Aug 3, 2023
@gardener-robot-ci-3 gardener-robot-ci-3 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Aug 3, 2023
Updated etcd-druid to propagate --delta-snapshot-retention-period flag from the Etcd CRD to etcd-backup-restore.
@seshachalam-yv seshachalam-yv force-pushed the feature/add-delta-snapshot-retention-period branch from da9d680 to 072cea6 Compare August 3, 2023 11:23
@gardener-robot-ci-3 gardener-robot-ci-3 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Aug 3, 2023
@seshachalam-yv seshachalam-yv changed the title Add DeltaSnapshotRetentionPeriod Field to Etcd CRD Extend Etcd CRD and etcd-druid to Support Configurable Delta Snapshot Retention Aug 3, 2023
Copy link
Contributor

@shreyas-s-rao shreyas-s-rao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@seshachalam-yv thanks for your PR. I have a few comments. PTAL.

Please also change the release note to something like:

Introduce `Spec.Backup.DeltaSnapshotRetentionPeriod` in the `Etcd` resource to allow configuring retention period for delta snapshots.

(Release note does not need to have implementation details of the API, but just the general usage)

api/v1alpha1/types_etcd.go Outdated Show resolved Hide resolved
api/v1alpha1/types_etcd.go Outdated Show resolved Hide resolved
pkg/component/etcd/statefulset/statefulset_test.go Outdated Show resolved Hide resolved
@gardener-robot-ci-1 gardener-robot-ci-1 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Aug 4, 2023
@gardener-robot-ci-3 gardener-robot-ci-3 added the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Aug 4, 2023
@gardener-robot-ci-2 gardener-robot-ci-2 removed the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Aug 4, 2023
@gardener-robot
Copy link

@aaronfern You have pull request review open invite, please check

Copy link
Contributor

@shreyas-s-rao shreyas-s-rao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@gardener-robot gardener-robot added reviewed/lgtm Has approval for merging and removed needs/changes Needs (more) changes needs/review Needs review labels Aug 9, 2023
@gardener-robot-ci-3 gardener-robot-ci-3 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Aug 9, 2023
@seshachalam-yv seshachalam-yv merged commit 8df7251 into gardener:master Aug 9, 2023
@gardener-robot gardener-robot added the status/closed Issue is closed (either delivered or triaged) label Aug 9, 2023
@seshachalam-yv seshachalam-yv deleted the feature/add-delta-snapshot-retention-period branch August 9, 2023 08:12
@seshachalam-yv seshachalam-yv added this to the v0.20.0 milestone Oct 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/backup Backup related kind/api-change API change with impact on API users needs/ok-to-test Needs approval for testing (check PR in detail before setting this label because PR is run on CI/CD) reviewed/lgtm Has approval for merging size/m Size of pull request is medium (see gardener-robot robot/bots/size.py) status/closed Issue is closed (either delivered or triaged)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature] Extend Etcd CRD to Include DeltaSnapshotRetentionPeriod Field
7 participants