Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

kv/kvserver: TestReplicateQueueUpReplicateOddVoters failed #75718

Closed
cockroach-teamcity opened this issue Jan 30, 2022 · 4 comments
Closed

kv/kvserver: TestReplicateQueueUpReplicateOddVoters failed #75718

cockroach-teamcity opened this issue Jan 30, 2022 · 4 comments
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-storage Storage Team

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Jan 30, 2022 •
edited by cockroach-jira-scripts
Loading

kv/kvserver.TestReplicateQueueUpReplicateOddVoters failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

=== RUN   TestReplicateQueueUpReplicateOddVoters
    test_log_scope.go:79: test logs captured to: /artifacts/tmp/_tmp/751d67000aac5f3394c2369309253f02/logTestReplicateQueueUpReplicateOddVoters466645319
    test_log_scope.go:80: use -show-logs to present logs inline
Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

  • TAGS=bazel,gss

/cc @cockroachdb/kv

This test on roachdash | Improve this report!

Jira issue: CRDB-12803
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Jan 30, 2022
@tbg
Copy link
Member

tbg commented Jan 31, 2022 

=== RUN   TestReplicateQueueUpReplicateOddVoters
    test_log_scope.go:79: test logs captured to: /artifacts/tmp/_tmp/751d67000aac5f3394c2369309253f02/logTestReplicateQueueUpReplicateOddVoters466645319
    test_log_scope.go:80: use -show-logs to present logs inline
panic: close of closed channel [recovered]
	panic: close of closed channel [recovered]
	panic: close of closed channel

goroutine 995724 [running]:
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).Recover(0xc0053a4990, {0x544d8d8, 0xc00bd9e090})
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:251 +0x94
panic({0x3cc6b40, 0x5375500})
	GOROOT/src/runtime/panic.go:1038 +0x215
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).Recover(0xc0053a4990, {0x544d8d8, 0xc00bd9e180})
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:251 +0x94
panic({0x3cc6b40, 0x5375500})
	GOROOT/src/runtime/panic.go:1038 +0x215
github.com/cockroachdb/pebble/sstable.(*writeQueue).finish(...)
	github.com/cockroachdb/pebble/sstable/external/com_github_cockroachdb_pebble/sstable/write_queue.go:108
github.com/cockroachdb/pebble/sstable.(*Writer).Close(0xc002773500)
	github.com/cockroachdb/pebble/sstable/external/com_github_cockroachdb_pebble/sstable/writer.go:1047 +0xc7
github.com/cockroachdb/cockroach/pkg/storage.(*SSTWriter).Close(...)
	github.com/cockroachdb/cockroach/pkg/storage/sst_writer.go:296
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*multiSSTWriter).Close(0xc000ebf028)
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_snapshot.go:221 +0x2a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*kvBatchSnapshotStrategy).Receive(_, {_, _}, {_, _}, {{0x1c, 0xc, 0xc010900460, 0xc00dbdc660, 0xc009a1ae60, ...}, ...})
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_snapshot.go:272 +0x6c5
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).receiveSnapshot(0xc00351bb00, {0x544d8d8, 0xc00bd9e180}, 0xc00555f200, {0x7efcdb4885e0, 0xc006011eb0})
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_snapshot.go:679 +0x5c5
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).HandleSnapshot.func1({0x544d8d8, 0xc00bd9e180})
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:82 +0x145
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0053a4990, {0x544d8d8, 0xc00bd9e180}, {0x62f42f, 0xc00bd9e0c0}, 0xc002d72c48)
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344 +0xdd
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).HandleSnapshot(0xc00351bb00, {0x544d8d8, 0xc00bd9e090}, 0xc00555f200, {0x7efcdb4885b8, 0xc006011eb0})
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:72 +0xcc
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*RaftTransport).RaftSnapshot.func1.1({0x54b1ff0, 0xc006011eb0}, 0xc0005443c0, {0x544d8d8, 0xc00bd9e090})
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/raft_transport.go:434 +0x13a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*RaftTransport).RaftSnapshot.func1({0x544d8d8, 0xc00bd9e090})
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/raft_transport.go:435 +0x45
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:494 +0x16f
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:483 +0x445
I220130 11:43:36.147182 1 (gostd) testmain.go:1530  [-] 1  Test //pkg/kv/kvserver:kvserver_test exited with error code 2

@tbg tbg mentioned this issue Jan 31, 2022
Closed
@blathers-crl blathers-crl bot added the T-storage Storage Team label Jan 31, 2022
@tbg
Copy link
Member

tbg commented Jan 31, 2022

See #75717

@ajwerner
Copy link
Contributor

ajwerner commented Jan 31, 2022 •
edited by nicktrav
Loading

See also #75687.

@jbowens
Copy link
Collaborator

jbowens commented Apr 11, 2022

Fixed by cockroachdb/pebble#1485

@jbowens jbowens closed this as completed Apr 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-storage Storage Team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@jlinder @jbowens @ajwerner @tbg @cockroach-teamcity