Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: cdc/sink-chaos failed #54827

Closed
cockroach-teamcity opened this issue Sep 26, 2020 · 2 comments
Closed

roachtest: cdc/sink-chaos failed #54827

cockroach-teamcity opened this issue Sep 26, 2020 · 2 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Milestone
20.2

Comments

@cockroach-teamcity
Copy link
Member

(roachtest).cdc/sink-chaos failed on release-20.1@a84063ed9e7e3c43c710534629399bb957f17cca:

The test failed on branch=release-20.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/sink-chaos/run_1
	cluster.go:2209,cdc.go:743,cdc.go:104,cdc.go:533,test_runner.go:755: output in run_063558.620_n4_workload_fixtures_load_tpcc: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2324598-1601100222-28-n4cpu16:4 -- ./workload fixtures load tpcc --warehouses=100 --checks=false {pgurl:2} returned: exit status 20
		(1) attached stack trace
		  -- stack trace:
		  | main.(*cluster).RunE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2287
		  | main.(*cluster).Run
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2207
		  | main.(*tpccWorkload).install
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:743
		  | main.cdcBasicTest
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:104
		  | main.registerCDC.func4
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:533
		  | main.(*testRunner).runTest.func2
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:755
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		Wraps: (2) output in run_063558.620_n4_workload_fixtures_load_tpcc
		Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2324598-1601100222-28-n4cpu16:4 -- ./workload fixtures load tpcc --warehouses=100 --checks=false {pgurl:2} returned
		  | stderr:
		  | I200926 06:36:00.437553 1 ccl/workloadccl/cliccl/fixtures.go:284  starting restore of 9 tables
		  | Error: restoring fixture: pq: storage: object doesn't exist
		  | Error: COMMAND_PROBLEM: exit status 1
		  | (1) COMMAND_PROBLEM
		  | Wraps: (2) Node 4. Command with error:
		  |   | ```
		  |   | ./workload fixtures load tpcc --warehouses=100 --checks=false {pgurl:2}
		  |   | ```
		  | Wraps: (3) exit status 1
		  | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
		  |
		  | stdout:
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /cdc/sink-chaos

See this test on roachdash
powered by pkg/cmd/internal/issues
@cockroach-teamcity cockroach-teamcity added branch-release-20.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Sep 26, 2020
@cockroach-teamcity cockroach-teamcity added this to the 20.2 milestone Sep 26, 2020
@cockroach-teamcity
Copy link
Member Author

(roachtest).cdc/sink-chaos failed on release-20.1@5a4e41010f8faa095c88e2e5b142e0b6880c9f44:

The test failed on branch=release-20.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/sink-chaos/run_1
	cluster.go:2209,cdc.go:743,cdc.go:104,cdc.go:533,test_runner.go:755: output in run_064537.312_n4_workload_fixtures_load_tpcc: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2328549-1601359472-29-n4cpu16:4 -- ./workload fixtures load tpcc --warehouses=100 --checks=false {pgurl:2} returned: exit status 20
		(1) attached stack trace
		  -- stack trace:
		  | main.(*cluster).RunE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2287
		  | main.(*cluster).Run
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2207
		  | main.(*tpccWorkload).install
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:743
		  | main.cdcBasicTest
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:104
		  | main.registerCDC.func4
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:533
		  | main.(*testRunner).runTest.func2
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:755
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		Wraps: (2) output in run_064537.312_n4_workload_fixtures_load_tpcc
		Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2328549-1601359472-29-n4cpu16:4 -- ./workload fixtures load tpcc --warehouses=100 --checks=false {pgurl:2} returned
		  | stderr:
		  | I200929 06:45:39.158621 1 ccl/workloadccl/cliccl/fixtures.go:284  starting restore of 9 tables
		  | I200929 06:45:39.172540 124 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/order_line
		  | I200929 06:45:39.172584 116 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/warehouse
		  | I200929 06:45:39.172556 119 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/history
		  | I200929 06:45:39.172611 122 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/item
		  | I200929 06:45:39.172617 120 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/order
		  | I200929 06:45:39.172672 123 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/stock
		  | I200929 06:45:39.172695 117 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/district
		  | I200929 06:45:39.172724 118 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/customer
		  | I200929 06:45:39.172583 121 ccl/workloadccl/fixture.go:583  Restoring from gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/new_order
		  | Error: restoring fixture: backup: gs://cockroach-fixtures/workload/tpcc/version=2.2.0,deprecated-fk-indexes=false,fks=true,interleaved=false,seed=1,warehouses=100/stock: pq: storage: object doesn't exist
		  | Error: COMMAND_PROBLEM: exit status 1
		  | (1) COMMAND_PROBLEM
		  | Wraps: (2) Node 4. Command with error:
		  |   | ```
		  |   | ./workload fixtures load tpcc --warehouses=100 --checks=false {pgurl:2}
		  |   | ```
		  | Wraps: (3) exit status 1
		  | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
		  |
		  | stdout:
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /cdc/sink-chaos

See this test on roachdash
powered by pkg/cmd/internal/issues

@RaduBerinde
Copy link
Member

Same as #54822.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Projects
None yet
Milestone
20.2
Development

No branches or pull requests
2 participants
@RaduBerinde @cockroach-teamcity