Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ccl/backupccl: TestClusterRestoreFailCleanup failed #92896

Closed
cockroach-teamcity opened this issue Dec 2, 2022 · 3 comments
Closed

ccl/backupccl: TestClusterRestoreFailCleanup failed #92896

cockroach-teamcity opened this issue Dec 2, 2022 · 3 comments
Assignees
@msbutler
Labels
branch-release-22.2 Used to mark GA and release blockers, technical advisories, and bugs for 22.2 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-disaster-recovery
Milestone
22.2

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Dec 2, 2022 •
edited by cockroach-jira-scripts
Loading

ccl/backupccl.TestClusterRestoreFailCleanup failed with artifacts on release-22.2 @ b1378718eb74f0412035acee659ce3b7941ab3dd:

=== RUN   TestClusterRestoreFailCleanup
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/95e138e66d69292427dfb9528cf06d04/logTestClusterRestoreFailCleanup3225252859
    test_log_scope.go:79: use -show-logs to present logs inline
    full_cluster_backup_restore_test.go:607: error executing 'BACKUP TO 'nodelocal://1/missing-ssts'': pq: failed to run backup: writing forward-compat metadata sst: pebble: keys must be added in strictly increasing order: "stats/\x8c\x88"/0,0#0,SET, "stats/\x8c\x88"/0,0#0,SET
    panic.go:522: -- test log scope end --
/artifacts/tmp/_tmp/95e138e66d69292427dfb9528cf06d04/TestDataDriven_restore-validation-only3829916060/full_database_backup/2022/12/02-083744.09/data/818871875263234049.ssttest logs left over in: /artifacts/tmp/_tmp/95e138e66d69292427dfb9528cf06d04/logTestClusterRestoreFailCleanup3225252859
--- FAIL: TestClusterRestoreFailCleanup (218.04s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-22031
@cockroach-teamcity cockroach-teamcity added branch-release-22.2 Used to mark GA and release blockers, technical advisories, and bugs for 22.2 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Dec 2, 2022
@cockroach-teamcity cockroach-teamcity added this to the 22.2 milestone Dec 2, 2022
@cockroach-teamcity
Copy link
Member Author

ccl/backupccl.TestClusterRestoreFailCleanup failed with artifacts on release-22.2 @ 45cceae6a1277ab1970d24806cb57230814bf494:

=== RUN   TestClusterRestoreFailCleanup
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/95e138e66d69292427dfb9528cf06d04/logTestClusterRestoreFailCleanup2591473907
    test_log_scope.go:79: use -show-logs to present logs inline
    full_cluster_backup_restore_test.go:607: error executing 'BACKUP TO 'nodelocal://1/missing-ssts'': pq: failed to run backup: writing forward-compat metadata sst: pebble: keys must be added in strictly increasing order: "stats/\x8c\x88"/0,0#0,SET, "stats/\x8c\x88"/0,0#0,SET
    panic.go:522: -- test log scope end --
/artifacts/tmp/_tmp/95e138e66d69292427dfb9528cf06d04/TestDataDriven_restore-validation-only1264175192/full_database_backup/2022/12/09-074312.34/data/820842963104563201.ssttest logs left over in: /artifacts/tmp/_tmp/95e138e66d69292427dfb9528cf06d04/logTestClusterRestoreFailCleanup2591473907
--- FAIL: TestClusterRestoreFailCleanup (231.58s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@msbutler
Copy link
Collaborator

this is barking because of #86806

I'm unsure why this test in particular is surfacing this error. To prevent further flakes on 22.2, where the MetadataSST feature isn't available, I'm going to remove the metamorphic test bool.

@msbutler msbutler self-assigned this Dec 16, 2022
@msbutler msbutler mentioned this issue Dec 16, 2022
Merged
@msbutler
Copy link
Collaborator

fixed by #93833

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@msbutler msbutler

Labels
branch-release-22.2 Used to mark GA and release blockers, technical advisories, and bugs for 22.2 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-disaster-recovery
Projects
No open projects
Disaster Recovery Backlog
Archived in project
Milestone
22.2
Development

No branches or pull requests
2 participants
@cockroach-teamcity @msbutler