Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: copy/bank/rows=10000000,nodes=9,txn=false failed #37543

Closed
cockroach-teamcity opened this issue May 16, 2019 · 2 comments
Closed

roachtest: copy/bank/rows=10000000,nodes=9,txn=false failed #37543

cockroach-teamcity opened this issue May 16, 2019 · 2 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

SHA: https://github.com/cockroachdb/cockroach/commits/c8bda1de440cfe90cf23a433119d77795cfa0047

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=copy/bank/rows=10000000,nodes=9,txn=false PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1292152&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
	copy.go:119,cluster.go:1812,errgroup.go:57: failed to copy rows: pq: result is ambiguous (removing replica)
	cluster.go:1833,copy.go:132,copy.go:144,test.go:1251: Goexit() was called

@cockroach-teamcity cockroach-teamcity added this to the 19.2 milestone May 16, 2019
@cockroach-teamcity cockroach-teamcity added C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. labels May 16, 2019
@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/9671342fead0509bec0913bae4ae1f244660788e

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=copy/bank/rows=10000000,nodes=9,txn=false PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1298500&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
	cluster.go:1474,copy.go:53,cluster.go:1812,errgroup.go:57: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1298500-copy-bank-rows-10000000-nodes-9-txn-false:1 -- ./workload fixtures load bank --rows=10000000 --payload-bytes=100 {pgurl:1} returned:
		stderr:
		
		stdout:
		I190521 06:31:12.570590 1 ccl/workloadccl/cliccl/fixtures.go:300  starting load of 1 tables
		I190521 06:31:28.827551 43 ccl/workloadccl/fixture.go:468  loaded 1.1 GiB table bank in 16.256815948s (10000000 rows, 0 index entries, 67 MiB)
		I190521 06:31:28.827669 1 workload/workload.go:562  starting 9 splits
		Error: restoring fixture: splitting bank: ALTER TABLE bank SPLIT AT VALUES (5000000): pq: splits would be immediately discarded by merge queue; disable the merge queue first by running 'SET CLUSTER SETTING kv.range_merge.queue_enabled = false'
		Error:  ssh verbose log retained in /root/.roachprod/debug/ssh_35.196.34.196_2019-05-21T06:31:11Z: exit status 1
		: exit status 1
	cluster.go:1833,copy.go:132,copy.go:144,test.go:1251: Goexit() was called

@nvanbenschoten
Copy link
Member

Fixed by #37684.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Projects
None yet
Development

No branches or pull requests

2 participants