Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: follower-reads/survival=zone/locality=regional/reads=bounded-staleness/insufficient-quorum failed #75716

Closed
cockroach-teamcity opened this issue Jan 30, 2022 · 1 comment · Fixed by #75739
Closed

roachtest: follower-reads/survival=zone/locality=regional/reads=bounded-staleness/insufficient-quorum failed #75716

cockroach-teamcity opened this issue Jan 30, 2022 · 1 comment · Fixed by #75739
Assignees
@andreimatei
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.

Comments

@cockroach-teamcity
Copy link
Member

roachtest.follower-reads/survival=zone/locality=regional/reads=bounded-staleness/insufficient-quorum failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/follower-reads/survival=zone/locality=regional/reads=bounded-staleness/insufficient-quorum/run_1
	follower_reads.go:270,follower_reads.go:72,test_runner.go:780: failed to get follower read counts: Get "http://34.139.80.249:26258/_status/vars": dial tcp 34.139.80.249:26258: connect: connection refused
Help

See: roachtest README

See: How To Investigate (internal)

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Jan 30, 2022
@cockroach-teamcity
Copy link
Member Author

roachtest.follower-reads/survival=zone/locality=regional/reads=bounded-staleness failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/follower-reads/survival=zone/locality=regional/reads=bounded-staleness/run_1
	follower_reads.go:260,follower_reads.go:72,test_runner.go:780: dial tcp 34.75.135.217:26257: connect: connection refused
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

andreimatei added a commit to andreimatei/cockroach that referenced this issue Jan 31, 2022
@andreimatei
sql: fix the sql.trace.stmt.enable_threshold cluster setting
13c3b7c 
This setting had rotted, leading to a span use-after-Finish.

This was caught by the recently-unskipped follower reads roachtests
(roachtests panic on use-after-finish), accounting for all the issues
below. The last entry in these issues refers to the nodes crashing
because of the bug fixed here. Some of these issues have been open for a
long time for more relevant failures - those have been fixed in cockroachdb#72296.

Fixes cockroachdb#75716
Fixes cockroachdb#75715
Fixes cockroachdb#75714
Fixes cockroachdb#71244
Fixes cockroachdb#71126
Fixes cockroachdb#70818
Fixes cockroachdb#70191
Fixes cockroachdb#70011
Fixes cockroachdb#70010
Fixes cockroachdb#69952
Fixes cockroachdb#69951

Release note: None
@andreimatei andreimatei mentioned this issue Jan 31, 2022
Merged
andreimatei added a commit to andreimatei/cockroach that referenced this issue Jan 31, 2022
@andreimatei
sql: fix the sql.trace.stmt.enable_threshold cluster setting
e85fe73 
This setting had rotted, leading to a span use-after-Finish.

This was caught by the recently-unskipped follower reads roachtests
(roachtests panic on use-after-finish), accounting for all the issues
below. The last entry in these issues refers to the nodes crashing
because of the bug fixed here. Some of these issues have been open for a
long time for more relevant failures - those have been fixed in cockroachdb#72296.

Fixes cockroachdb#75716
Fixes cockroachdb#75715
Fixes cockroachdb#75714
Fixes cockroachdb#71244
Fixes cockroachdb#71126
Fixes cockroachdb#70818
Fixes cockroachdb#70191
Fixes cockroachdb#70011
Fixes cockroachdb#70010
Fixes cockroachdb#69952
Fixes cockroachdb#69951

Release note: None
craig bot pushed a commit that referenced this issue Feb 1, 2022
@andreimatei @yuzefovich
Merge #75739 #75764
19a5d53 
75739: sql: fix the sql.trace.stmt.enable_threshold cluster setting  r=andreimatei a=andreimatei

This setting had rotted, leading to a span use-after-Finish.

This was caught by the recently-unskipped follower reads roachtests
(roachtests panic on use-after-finish), accounting for all the issues
below. The last entry in these issues refers to the nodes crashing
because of the bug fixed here. Some of these issues have been open for a
long time for more relevant failures - those have been fixed in #72296.

Fixes #75716
Fixes #75715
Fixes #75714
Fixes #71244
Fixes #71126
Fixes #70818
Fixes #70191
Fixes #70011
Fixes #70010
Fixes #69952
Fixes #69951

Release note: None

75764: roachtest: add a variant of tpch_concurrency with no admission control r=yuzefovich a=yuzefovich

Informs: #74836.

Release note: None

Co-authored-by: Andrei Matei <[email protected]>
Co-authored-by: Yahor Yuzefovich <[email protected]>
@craig craig bot closed this as completed in f5d78e2 Feb 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@andreimatei andreimatei

Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

sql: fix the sql.trace.stmt.enable_threshold cluster setting andreimatei/cockroach
2 participants
@andreimatei @cockroach-teamcity