roachtest: acceptance/version-upgrade failed

[cockroach-teamcity]

(roachtest).acceptance/version-upgrade failed on master@5c97fdbe214431404f8dd4cad69bfa008d1e4bbc:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: artifacts/acceptance/version-upgrade/run_1
	versionupgrade.go:433,versionupgrade.go:410,versionupgrade.go:186,versionupgrade.go:174,acceptance.go:58,acceptance.go:95,test_runner.go:754: pq: no inbound stream connection

More

Artifacts: /acceptance/version-upgrade

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[cockroach-teamcity]

(roachtest).acceptance/version-upgrade failed on master@38987bc28581b53c9764e0122f6971cebd1408ec:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: artifacts/acceptance/version-upgrade/run_1
	versionupgrade.go:433,versionupgrade.go:410,versionupgrade.go:186,versionupgrade.go:174,acceptance.go:58,acceptance.go:95,test_runner.go:754: pq: no inbound stream connection

More

Artifacts: /acceptance/version-upgrade

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[irfansharif]

E200825 05:44:12.758884 908 sql/flowinfra/flow_registry.go:255  [n2,client=127.0.0.1:52204,hostnossl,user=root] flow id:e4c673e6-17f8-4806-af40-9e5ae04958b4 : 1 inbound streams timed out after 10s; propagated error throughout flow

Eventually getting to:

pq: no inbound stream connection

I'm not sure what this is. I don't see any other errors (but also only took a very cursory glance).

[yuzefovich]

I'll assign to @asubiotto since he was looking into it recently.

[irfansharif]

#50000 (comment) is what's happening here. The error does in fact trip up the predecessor version node.

[cockroach-teamcity]

(roachtest).acceptance/version-upgrade failed on master@cfcb2dc83d598d7a376b30b83284a18d6088f7dd:

		  |   | main.main
		  |   | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1839
		  |   | runtime.main
		  |   | 	/usr/local/go/src/runtime/proc.go:203
		  |   | runtime.goexit
		  |   | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		  | Wraps: (2) 1: dead
		  | Error types: (1) *withstack.withStack (2) *errutil.leafError
		Wraps: (4) secondary error attachment
		  | 4: dead
		  | (1) attached stack trace
		  |   -- stack trace:
		  |   | main.glob..func14
		  |   | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1143
		  |   | main.wrap.func1
		  |   | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:267
		  |   | github.com/spf13/cobra.(*Command).execute
		  |   | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:830
		  |   | github.com/spf13/cobra.(*Command).ExecuteC
		  |   | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:914
		  |   | github.com/spf13/cobra.(*Command).Execute
		  |   | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:864
		  |   | main.main
		  |   | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1839
		  |   | runtime.main
		  |   | 	/usr/local/go/src/runtime/proc.go:203
		  |   | runtime.goexit
		  |   | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		  | Wraps: (2) 4: dead
		  | Error types: (1) *withstack.withStack (2) *errutil.leafError
		Wraps: (5) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1143
		  | main.wrap.func1
		  | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:267
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:830
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:914
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:864
		  | main.main
		  | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1839
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:203
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		Wraps: (6) 3: dead
		Error types: (1) errors.Unclassified (2) *secondary.withSecondaryError (3) *secondary.withSecondaryError (4) *secondary.withSecondaryError (5) *withstack.withStack (6) *errutil.leafError

More

Artifacts: /acceptance/version-upgrade

See this test on roachdash
_{powered by pkg/cmd/internal/issues}