Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sql/opt/exec/execbuilder: TestExecBuild failed #54753

Closed
cockroach-teamcity opened this issue Sep 24, 2020 · 4 comments
Closed

sql/opt/exec/execbuilder: TestExecBuild failed #54753

cockroach-teamcity opened this issue Sep 24, 2020 · 4 comments
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Milestone
20.2

Comments

@cockroach-teamcity
Copy link
Member

(sql/opt/exec/execbuilder).TestExecBuild failed on master@e3b3134dc4f6a725948cd453bee6cb39e7846390:

Fatal error:

panic: pebble: closed

Stack:

goroutine 260902 [running]:
github.com/cockroachdb/pebble.(*DB).Apply(0xc0002f8000, 0xc00b8a1d10, 0x7fdf601, 0xc009794d80, 0x10)
	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/db.go:524 +0x3f5
github.com/cockroachdb/pebble.(*Batch).Commit(...)
	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/batch.go:727
github.com/cockroachdb/cockroach/pkg/storage.(*pebbleMapBatchWriter).Flush(0xc009794d50, 0x203004, 0x203004)
	/go/src/github.com/cockroachdb/cockroach/pkg/storage/disk_map.go:434 +0x48
github.com/cockroachdb/cockroach/pkg/sql/rowcontainer.(*DiskRowContainer).newIterator(0xc00bad2640, 0x5704e20, 0xc00bb3b540, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/rowcontainer/disk_row_container.go:439 +0x53
github.com/cockroachdb/cockroach/pkg/sql/rowcontainer.(*DiskRowContainer).NewFinalIterator(0xc00bad2640, 0x5704e20, 0xc00bb3b540, 0x5704e20, 0xc00bb3b540)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/rowcontainer/disk_row_container.go:519 +0x74
github.com/cockroachdb/cockroach/pkg/sql/rowcontainer.(*DiskBackedRowContainer).NewFinalIterator(0xc00bba8f00, 0x5704e20, 0xc00bb3b540, 0x0, 0x0)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/rowcontainer/row_container.go:534 +0x47
github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*sortAllProcessor).fill(0xc00a2daa00, 0x5704e20, 0xc00bb3b540, 0x4742171)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/rowexec/sorter.go:309 +0x2ef
github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*sortAllProcessor).Start(0xc00a2daa00, 0x5704e20, 0xc00bb3b540, 0x7fe2200, 0x4095d00)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/rowexec/sorter.go:272 +0xab
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBase).Run(0xc00a2daa00, 0x5704e20, 0xc00bb3b540)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:774 +0x52
github.com/cockroachdb/cockroach/pkg/sql/flowinfra.(*FlowBase).Run(0xc009798480, 0x5704e20, 0xc00bb3b540, 0x4cf0230, 0x0, 0x0)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/flowinfra/flow.go:392 +0x24d
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run(0xc00e9a5290, 0xc012ed3ce0, 0xc00bb84480, 0xc00bbb4a00, 0xc0059fae00, 0xc00badb520, 0x0, 0x0)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:422 +0x5d9
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun(0xc00e9a5290, 0x5704ee0, 0xc00bb395c0, 0xc00badb520, 0xc012ed3ce0, 0xc00bb84480, 0x57079e0, 0xc009794840, 0x0, 0xc0059fae00, ...)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:991 +0x1d1
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine(0xc00badb000, 0x5704ee0, 0xc00bb395c0, 0xc00badb420, 0x3, 0x5773900, 0xc022f5f140, 0xc00bd02200, 0xc022f5f1f8, 0x0, ...)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1002 +0x3c0
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine(0xc00badb000, 0x5704ee0, 0xc00bb395c0, 0xc00badb420, 0x5773900, 0xc022f5f140, 0x0, 0x0)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:873 +0x6ff
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState(0xc00badb000, 0x5704ee0, 0xc00bb395c0, 0x57239e0, 0xc0143a4280, 0x48cab83, 0xca, 0x1, 0x1, 0xc002cf8d80, ...)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:639 +0xb96
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt(0xc00badb000, 0x5704ee0, 0xc00bb395c0, 0x57239e0, 0xc0143a4280, 0x48cab83, 0xca, 0x1, 0x1, 0xc002cf8d80, ...)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:114 +0x909
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execPortal(0xc00badb000, 0x5704ee0, 0xc00bb39590, 0xc00ba6a4b0, 0xc00fa85450, 0x1, 0x1, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:203 +0x27e
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd(0xc00badb000, 0x5704ee0, 0xc00bb39560, 0x0, 0x0)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1528 +0x10a7
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run(0xc00badb000, 0x5704ee0, 0xc00bb38150, 0xc000938f00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1401 +0x1ce
github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).initConnEx.func1(0xc00badb000, 0x5704ee0, 0xc00bb38150, 0xc0035d7740, 0xc0124546c0, 0x0, 0xc01602f080)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:175 +0x64
created by github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).initConnEx
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:174 +0x2f0
Log preceding fatal error

=== RUN   TestExecBuild/fakedist-disk/geospatial
=== PAUSE TestExecBuild/fakedist-disk/geospatial
=== CONT  TestExecBuild/fakedist-disk/geospatial
--- done: testdata/virtual with config fakedist-disk: 10 tests, 0 failures
--- done: testdata/geospatial with config fakedist-disk: 10 tests, 0 failures
--- total progress: 2445 statements/queries
--- progress: testdata/distsql_automatic_stats: 15 statements/queries
--- done: testdata/distsql_automatic_stats with config fakedist-disk: 21 tests, 0 failures

More

Parameters:

  • GOFLAGS=-json
make stressrace TESTS=TestExecBuild PKG=./pkg/sql/opt/exec/execbuilder TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

See this test on roachdash
powered by pkg/cmd/internal/issues
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Sep 24, 2020
@cockroach-teamcity cockroach-teamcity added this to the 20.2 milestone Sep 24, 2020
@RaduBerinde RaduBerinde removed their assignment Sep 25, 2020
@cockroach-teamcity cockroach-teamcity mentioned this issue Sep 28, 2020
Closed
@yuzefovich
Copy link
Member

Adding branch-release-20.2 label because this issue occurred on that branch in #54892.

@cockroach-teamcity
Copy link
Member Author

(sql/opt/exec/execbuilder).TestExecBuild failed on master@1ccc24d83f4c39d7134ba3b955a9b56717d6043d:

=== PAUSE TestExecBuild/local/schema_change_in_txn
=== CONT  TestExecBuild/local/schema_change_in_txn
--- done: testdata/aggregate with config local: 70 tests, 0 failures
E201209 00:59:41.691587 3103 sql/stats/automatic_stats.go:300  failed to refresh stats: node unavailable; try another peer
--- total progress: 125 statements/queries
=== CONT  TestExecBuild/local/schema_change_in_txn
    logic.go:2166: 
         
        testdata/schema_change_in_txn:27: SELECT message FROM [SHOW KV TRACE FOR SESSION] WHERE message like 'CPut /Table/53/%'OR message like 'Put /Table/53/%'OR message like 'InitPut /Table/53/%'OR message like 'Del /Table/53/%'OR message like 'DelRange /Table/53/%'OR message like 'ClearRange /Table/53/%'OR message like 'Get /Table/53/%'OR message like 'Scan /Table/53/%'
        expected:
            Scan /Table/53/{1-2}
            CPut /Table/53/1/101/0 -> /TUPLE/2:2:Decimal/1000.2/1:3:Bytes/empty
            CPut /Table/53/1/101/1/1 -> /TUPLE/4:4:Decimal/0.00/2:6:Decimal/1101.2
            
        but found (query options: "kvtrace(prefix=/Table/53/)") :
            Scan /Table/53/{1-2}
            Scan /Table/53/{1/100/1/1-2}
            CPut /Table/53/1/101/0 -> /TUPLE/2:2:Decimal/1000.2/1:3:Bytes/empty
            CPut /Table/53/1/101/1/1 -> /TUPLE/4:4:Decimal/0.00/2:6:Decimal/1101.2
--- done: testdata/schema_change_in_txn with config local: 4 tests, 1 failures
E201209 00:59:42.590972 91 sql/logictest/logic.go:3402  testdata/schema_change_in_txn:34: too many errors encountered, skipping the rest of the input
    logic.go:2936: 
        testdata/schema_change_in_txn:34: error while processing
    logic.go:2936: testdata/schema_change_in_txn:34: too many errors encountered, skipping the rest of the input
E201209 00:59:42.608217 22414 sql/stats/automatic_stats.go:300  failed to refresh stats: node unavailable; try another peer
        --- FAIL: TestExecBuild/local/schema_change_in_txn (1.17s)
=== RUN   TestExecBuild/local/partial_index
=== PAUSE TestExecBuild/local/partial_index
=== CONT  TestExecBuild/local/partial_index
--- done: testdata/limit with config local: 16 tests, 0 failures
=== CONT  TestExecBuild/local/partial_index
    logic.go:2166: 
         
        testdata/partial_index:962: SELECT message FROM [SHOW KV TRACE FOR SESSION] WHERE message like 'CPut %'OR message like 'Put %'OR message like 'InitPut %'OR message like 'Del %'OR message like 'DelRange %'OR message like 'ClearRange %'OR message like 'Get %'OR message like 'Scan %'
        expected:
            DelRange /Table/56/1/1 - /Table/56/1/1/#
            Scan /Table/57/{1-2}
            Del /Table/57/2/1/10/0
            Del /Table/57/1/10/0
            Del /Table/57/1/20/0
        but found (query options: "kvtrace") :
            DelRange /Table/56/1/1 - /Table/56/1/1/#
            Scan /Table/57/{1-2}
            Scan /Table/57/{1/20/0-2}
            Del /Table/57/2/1/10/0
            Del /Table/57/1/10/0
            Scan /Table/57/{1/30/0-2}
            Del /Table/57/1/20/0
--- done: testdata/partial_index with config local: 111 tests, 1 failures
        --- FAIL: TestExecBuild/local/partial_index (4.62s)
More

Parameters:

  • GOFLAGS=-json
make stressrace TESTS=TestExecBuild PKG=./pkg/sql/opt/exec/execbuilder TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

See this test on roachdash
powered by pkg/cmd/internal/issues

@yuzefovich
Copy link
Member

The latest failure is me playing with a metamorphic build config.

@yuzefovich
Copy link
Member

I'll close this issue as a dup of #51544.

@yuzefovich yuzefovich mentioned this issue Dec 9, 2020
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Projects
None yet
Milestone
20.2
Development

No branches or pull requests
3 participants
@yuzefovich @RaduBerinde @cockroach-teamcity