Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: kv0/enc=false/nodes=3/cpu=32/size=64kb failed #37652

Closed
cockroach-teamcity opened this issue May 21, 2019 · 2 comments
Closed

roachtest: kv0/enc=false/nodes=3/cpu=32/size=64kb failed #37652

cockroach-teamcity opened this issue May 21, 2019 · 2 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

SHA: https://github.com/cockroachdb/cockroach/commits/9671342fead0509bec0913bae4ae1f244660788e

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=kv0/enc=false/nodes=3/cpu=32/size=64kb PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1298500&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
	cluster.go:1474,kv.go:69,cluster.go:1812,errgroup.go:57: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1298500-kv0-enc-false-nodes-3-cpu-32-size-64kb:4 -- ./workload run kv --init --splits=1000 --histograms=logs/stats.json --concurrency=192 --duration=10m --read-percent=0 --min-block-bytes=65536 --max-block-bytes=65536 {pgurl:1-3} returned:
		stderr:
		
		stdout:
		I190521 10:57:38.143558 1 workload/workload.go:562  starting 1000 splits
		Error: ALTER TABLE kv SPLIT AT VALUES (9214157878976512): pq: splits would be immediately discarded by merge queue; disable the merge queue first by running 'SET CLUSTER SETTING kv.range_merge.queue_enabled = false'
		Error:  ssh verbose log retained in /root/.roachprod/debug/ssh_34.74.197.120_2019-05-21T10:57:36Z: exit status 1
		: exit status 1
	cluster.go:1833,kv.go:72,kv.go:137,test.go:1251: Goexit() was called

@cockroach-teamcity cockroach-teamcity added this to the 19.2 milestone May 21, 2019
@cockroach-teamcity cockroach-teamcity added C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. labels May 21, 2019
@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/9671342fead0509bec0913bae4ae1f244660788e

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=kv0/enc=false/nodes=3/size=64kb PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1298500&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
	cluster.go:1474,kv.go:69,cluster.go:1812,errgroup.go:57: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1298500-kv0-enc-false-nodes-3-size-64kb:4 -- ./workload run kv --init --splits=1000 --histograms=logs/stats.json --concurrency=192 --duration=10m --read-percent=0 --min-block-bytes=65536 --max-block-bytes=65536 {pgurl:1-3} returned:
		stderr:
		
		stdout:
		I190521 11:00:46.738182 1 workload/workload.go:562  starting 1000 splits
		Error: ALTER TABLE kv SPLIT AT VALUES (9214157878976512): pq: splits would be immediately discarded by merge queue; disable the merge queue first by running 'SET CLUSTER SETTING kv.range_merge.queue_enabled = false'
		Error:  ssh verbose log retained in /root/.roachprod/debug/ssh_34.74.112.162_2019-05-21T11:00:45Z: exit status 1
		: exit status 1
	cluster.go:1833,kv.go:72,kv.go:137,test.go:1251: Goexit() was called

@nvanbenschoten
Copy link
Member

Fixed by #37684.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Projects
None yet
Development

No branches or pull requests

2 participants