Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: add mixed-version global table follower read test #117294

Conversation

nvanbenschoten
Copy link
Member

This commit adds a new mixed-version roachtest called:

follower-reads/mixed-version/survival=region/locality=global/reads=strong

This test runs a multi-region follower-read test with a region-survivable global table while performing a cluster upgrade.

I'm adding this test to give us more confidence that we're not breaking anything when removing the synthetic timestamp bit in #101938.

Epic: None
Release note: None

@nvanbenschoten nvanbenschoten requested a review from a team as a code owner January 3, 2024 21:14
@nvanbenschoten nvanbenschoten requested review from herkolategan and renatolabs and removed request for a team January 3, 2024 21:14
@cockroach-teamcity
Copy link
Member

This change is Reviewable

@nvanbenschoten
Copy link
Member Author

This would have caught the replica inconsistency described in #117302.

@nvanbenschoten nvanbenschoten force-pushed the nvanbenschoten/mixedVersionGlobalTable branch from 75365bd to 84436b1 Compare January 4, 2024 00:00
mixedversion.NeverUseFixtures,
// Use a longer upgrade timeout to give the migrations enough time to finish
// considering the cross-region latency.
mixedversion.UpgradeTimeout(60*time.Minute),
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Curious how long it takes today?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The entire test takes about 80 minutes. I did see one instance where an upgrade migration timed out after 10m, so I'm conservatively bumping this up to give migrations more time.

@srosenberg srosenberg self-requested a review January 4, 2024 00:16
Copy link
Collaborator

@arulajmani arulajmani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewed 1 of 1 files at r1, all commit messages.
Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @herkolategan, @renatolabs, and @srosenberg)

This commit adds a new mixed-version roachtest called
`follower-reads/mixed-version/survival=region/locality=global/reads=strong`,
which runs a multi-region follower-read test with a region-survivable global
table while performing a cluster upgrade.

Epic: None
Release note: None
@nvanbenschoten nvanbenschoten force-pushed the nvanbenschoten/mixedVersionGlobalTable branch from 84436b1 to 895ebc7 Compare January 5, 2024 00:05
@nvanbenschoten
Copy link
Member Author

TFTRs!

Merging this as skipped because it will fail on master due to #117302. However, the test won't need to be skipped on release branches.

bors r+

@craig
Copy link
Contributor

craig bot commented Jan 5, 2024

This PR was included in a batch that timed out, it will be automatically retried

@craig
Copy link
Contributor

craig bot commented Jan 5, 2024

Build succeeded:

@craig craig bot merged commit ba84e57 into cockroachdb:master Jan 5, 2024
9 checks passed
@nvanbenschoten nvanbenschoten deleted the nvanbenschoten/mixedVersionGlobalTable branch January 9, 2024 19:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-23.1.x Flags PRs that need to be backported to 23.1 backport-23.2.x Flags PRs that need to be backported to 23.2.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants