roachtest: transfer-leases/drain failed [slow upreplication] #68169

cockroach-teamcity · 2021-07-28T11:30:34Z

roachtest.transfer-leases/drain failed with artifacts on master @ 8009ac6bb63f455a18bb1139d505bdd9930816b7:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:770: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See the corresponding section in the [roachtest README](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/roachtest)

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

The text was updated successfully, but these errors were encountered:

tbg · 2021-07-28T21:10:22Z

#68171 (comment)

…

On Wed, Jul 28, 2021 at 1:30 PM cockroach-teamcity ***@***.***> wrote: roachtest.transfer-leases/drain failed <https://teamcity.cockroachdb.com/viewLog.html?buildId=3233320&tab=buildLog> with artifacts <https://teamcity.cockroachdb.com/viewLog.html?buildId=3233320&tab=artifacts#/transfer-leases/drain> on master @ 8009ac6 <https://github.com/cockroachdb/cockroach/commits/8009ac6bb63f455a18bb1139d505bdd9930816b7> : The test failed on branch=master, cloud=gce: test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1 quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:770: cluster did not up-replicate: some ranges not up-replicated yet Reproduce See the corresponding section in the [roachtest README]( https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/roachtest) /cc @cockroachdb/kv-triage <https://github.com/orgs/cockroachdb/teams/kv-triage> This test on roachdash <https://roachdash.crdb.dev/?filter=status:open%20t:.*transfer-leases/drain.*&sort=title+created&display=lastcommented+project> | Improve this report! <https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues> — You are receiving this because you are on a team that was mentioned. Reply to this email directly, view it on GitHub <#68169>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABGXPZGZR3RNHIPPSBWNEGDTZ7S6LANCNFSM5BEFIQNA> .

cockroach-teamcity · 2021-07-29T11:40:34Z

roachtest.transfer-leases/drain failed with artifacts on master @ f19914b8c6281e463645580e1411774c3b0c20c9:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:770: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See the corresponding section in the [roachtest README](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/roachtest)

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-07-30T09:29:28Z

roachtest.transfer-leases/drain failed with artifacts on master @ fe1fb73ae989142193643db30dd4b1b6dd6fe7dd:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-07-31T11:28:58Z

roachtest.transfer-leases/drain failed with artifacts on master @ 701b177d8f4b81d8654dfb4090a2cd3cf82e63a7:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-01T09:38:01Z

roachtest.transfer-leases/drain failed with artifacts on master @ 31af9e32a55a166166e9ba9c5327b7cd847ae236:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-02T08:21:06Z

roachtest.transfer-leases/drain failed with artifacts on master @ c995342ead51e08f8ed1155de4218d30a00d86d2:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-03T09:41:37Z

roachtest.transfer-leases/drain failed with artifacts on master @ 1c46e1cd4e5be986bf9d13799bb7e13ddc896ed2:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-04T08:13:30Z

roachtest.transfer-leases/drain failed with artifacts on master @ eef03a46f2e43ff70485dadf7d9ad445db05cab4:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-05T12:13:21Z

roachtest.transfer-leases/drain failed with artifacts on master @ 6b8d59327add74cf1342345fb3eaffc3a3e765d2:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-06T12:30:59Z

roachtest.transfer-leases/drain failed with artifacts on master @ 50ef2fc205baa65c5a740c2d614fe1de279367e9:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-07T12:10:18Z

roachtest.transfer-leases/drain failed with artifacts on master @ cab185ff71f0924953d987fe6ffd14efdd32a3a0:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-09T12:45:12Z

roachtest.transfer-leases/drain failed with artifacts on master @ 62ec88c61edcaa023a579199cc5b43d3ee951cef:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-10T13:25:14Z

roachtest.transfer-leases/drain failed with artifacts on master @ 847514dab6354d4cc4ccf7b2857487b32119fb37:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-11T13:38:09Z

roachtest.transfer-leases/drain failed with artifacts on master @ 90809c048d05f923a67ce9b89597b2779fc73e32:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-12T14:58:29Z

roachtest.transfer-leases/drain failed with artifacts on master @ e723a85739a2e1b514f5de3221a2177a3a37d0e6:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-13T12:20:55Z

roachtest.transfer-leases/drain failed with artifacts on master @ 3928f1963833fbf51ae47bd2a42ae6a200ebbb14:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-14T12:42:57Z

roachtest.transfer-leases/drain failed with artifacts on master @ 0880e83e30ee5eb9aab7bb2297324e098d028225:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-15T12:57:48Z

roachtest.transfer-leases/drain failed with artifacts on master @ ee3efd6b1e24a3e1676778f5028fa0a35266f683:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-16T12:42:09Z

roachtest.transfer-leases/drain failed with artifacts on master @ 04a41e7915f4a89dcc1d0dbd92466c6adf79ec9f:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-08-17T12:54:45Z

roachtest.transfer-leases/drain failed with artifacts on master @ dd82053908203cf6d77c36c06a8280831bb93d57:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/transfer-leases/drain/run_1
	quit.go:67,quit.go:139,quit.go:73,quit.go:50,quit.go:347,test_runner.go:777: cluster did not up-replicate: some ranges not up-replicated yet

Reproduce

See: roachtest README

See: CI job to stress roachtests

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^transfer-leases/drain$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage _{This test on roachdash | Improve this report!}

tbg · 2021-08-23T08:43:26Z

This has recovered, I think it must've been caused by the bug I introduced to not pass the env vars through to CRDB properly.

cockroachdb#68169 (comment) Release justification: test-only change Release note: None

69232: roachtest: unskip restart-node-one test r=erikgrinaker a=tbg #68169 (comment) Closes #69232 Release justification: test-only change Release note: None Co-authored-by: Tobias Grieger <[email protected]>

tbg changed the title ~~roachtest: transfer-leases/drain failed~~ roachtest: transfer-leases/drain failed [slow upreplication] Jul 29, 2021

tbg assigned AlexTalks Jul 29, 2021

nvanbenschoten mentioned this issue Aug 6, 2021

release-21.1: kvserver: consider suspect stores "live" for computing quorum #68552

Merged

tbg closed this as completed Aug 23, 2021

This was referenced Aug 23, 2021

roachtest: acceptance/gossip/restart-node-one failed [slow replication] #68107

Closed

roachtest: unskip restart-node-one test #69232

Merged

tbg added a commit to tbg/cockroach that referenced this issue Aug 23, 2021

roachtest: unskip restart-node-one test

ac535fa

cockroachdb#68169 (comment) Release justification: test-only change Release note: None

tbg mentioned this issue Aug 23, 2021

roachtest: transfer-leases/signal failed [slow upreplication] #68171

Closed

erikgrinaker mentioned this issue Aug 23, 2021

roachtest: transfer-leases/quit failed [slow upreplication] #58492

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

roachtest: transfer-leases/drain failed [slow upreplication] #68169

roachtest: transfer-leases/drain failed [slow upreplication] #68169

cockroach-teamcity commented Jul 28, 2021

tbg commented Jul 28, 2021 via email

cockroach-teamcity commented Jul 29, 2021

cockroach-teamcity commented Jul 30, 2021

cockroach-teamcity commented Jul 31, 2021

cockroach-teamcity commented Aug 1, 2021

cockroach-teamcity commented Aug 2, 2021

cockroach-teamcity commented Aug 3, 2021

cockroach-teamcity commented Aug 4, 2021

cockroach-teamcity commented Aug 5, 2021

cockroach-teamcity commented Aug 6, 2021

cockroach-teamcity commented Aug 7, 2021

cockroach-teamcity commented Aug 9, 2021

cockroach-teamcity commented Aug 10, 2021

cockroach-teamcity commented Aug 11, 2021

cockroach-teamcity commented Aug 12, 2021

cockroach-teamcity commented Aug 13, 2021

cockroach-teamcity commented Aug 14, 2021

cockroach-teamcity commented Aug 15, 2021

cockroach-teamcity commented Aug 16, 2021

cockroach-teamcity commented Aug 17, 2021

tbg commented Aug 23, 2021

roachtest: transfer-leases/drain failed [slow upreplication] #68169

roachtest: transfer-leases/drain failed [slow upreplication] #68169

Comments

cockroach-teamcity commented Jul 28, 2021

tbg commented Jul 28, 2021 via email

cockroach-teamcity commented Jul 29, 2021

cockroach-teamcity commented Jul 30, 2021

cockroach-teamcity commented Jul 31, 2021

cockroach-teamcity commented Aug 1, 2021

cockroach-teamcity commented Aug 2, 2021

cockroach-teamcity commented Aug 3, 2021

cockroach-teamcity commented Aug 4, 2021

cockroach-teamcity commented Aug 5, 2021

cockroach-teamcity commented Aug 6, 2021

cockroach-teamcity commented Aug 7, 2021

cockroach-teamcity commented Aug 9, 2021

cockroach-teamcity commented Aug 10, 2021

cockroach-teamcity commented Aug 11, 2021

cockroach-teamcity commented Aug 12, 2021

cockroach-teamcity commented Aug 13, 2021

cockroach-teamcity commented Aug 14, 2021

cockroach-teamcity commented Aug 15, 2021

cockroach-teamcity commented Aug 16, 2021

cockroach-teamcity commented Aug 17, 2021

tbg commented Aug 23, 2021