Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

compose: TestComposeCompare failed #73421

Closed
cockroach-teamcity opened this issue Dec 3, 2021 · 179 comments
Closed

compose: TestComposeCompare failed #73421

cockroach-teamcity opened this issue Dec 3, 2021 · 179 comments
Assignees
@rafiss
Labels
C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. sync-me-8 T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Dec 3, 2021 •
edited by cockroach-jira-scripts
Loading

compose.TestComposeCompare failed with artifacts on release-21.2 @ 8fdbf4dacfdf3c2032937fe5359255f3dc13c61a:

        postgres_1    | 			AS tab_33492
        postgres_1    | 	ORDER BY
        postgres_1    | 		col_59994 NULLS FIRST, col_59995 NULLS FIRST, col_59996 NULLS FIRST, col_59997 NULLS FIRST, col_59998 NULLS FIRST
        test_1        | --- FAIL: TestCompare (658.61s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (56.01s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |               	pgtype.Numeric{
        test_1        |             - 		Int:    s"17320508075688772935",
        test_1        |             + 		Int:    s"1732050807568877",
        test_1        |             - 		Exp:    -19,
        test_1        |             + 		Exp:    -15,
        test_1        |               		Status: 2,
        test_1        |               		NaN:    false,
        test_1        |               	},
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT sqrt(3:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_60044) AS tab_33521
        test_1        |             ORDER BY
        test_1        |             	col_60044 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT sqrt(3::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_60044) AS tab_33521
        test_1        |             ORDER BY
        test_1        |             	col_60044 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

Jira issue: CRDB-11579
@cockroach-teamcity cockroach-teamcity added branch-release-21.2 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Dec 3, 2021
@cockroach-teamcity cockroach-teamcity mentioned this issue Dec 4, 2021
Closed
@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ de4cc9bf7f6719ef198958de984ab861ca02a8c5:

        postgres_1    | 		col_46382 NULLS FIRST,
        postgres_1    | 		col_46383 NULLS FIRST,
        postgres_1    | 		col_46384 NULLS FIRST
        test_1        | --- FAIL: TestCompare (636.17s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (32.82s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |               	pgtype.Numeric{
        test_1        |             - 		Int:    s"22360679774997896964",
        test_1        |             + 		Int:    s"2236067977499790",
        test_1        |             - 		Exp:    -19,
        test_1        |             + 		Exp:    -15,
        test_1        |               		Status: 2,
        test_1        |               		NaN:    false,
        test_1        |               	},
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT sqrt(5::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_46397) AS tab_24404
        test_1        |             ORDER BY
        test_1        |             	col_46397 NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT sqrt(5:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_46397) AS tab_24404
        test_1        |             ORDER BY
        test_1        |             	col_46397 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 8343f0aed1a685b7a90ea37b10bd3e0ed85e654e:

        test_1        | --- FAIL: TestCompare (624.30s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (21.48s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare postgres to cockroach1:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |               	pgtype.Numeric{
        test_1        |             - 		Int:    s"100776960000000000000000",
        test_1        |             + 		Int:    s"10077696",
        test_1        |             - 		Exp:    -16,
        test_1        |             + 		Exp:    0,
        test_1        |               		Status: 2,
        test_1        |               		NaN:    false,
        test_1        |               	},
        test_1        |               	nil,
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT (6::DECIMAL::DECIMAL::DECIMAL ^ 9::INT8::INT8::INT8)::DECIMAL AS col_20591, NULL::rand_typ_3 AS col_20592)
        test_1        |             		AS tab_15422
        test_1        |             ORDER BY
        test_1        |             	col_20591 NULLS FIRST, col_20592 NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT (6:::DECIMAL::DECIMAL::DECIMAL ^ 9:::INT8::INT8::INT8)::DECIMAL AS col_20591, NULL::rand_typ_3 AS col_20592)
        test_1        |             		AS tab_15422
        test_1        |             ORDER BY
        test_1        |             	col_20591 NULLS FIRST, col_20592 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 5c388180155f306a1685ac88bfbeeb03785313dd:

        test_1        | 
        test_1        | goroutine 25 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee3e00, 0x4055dd0)
        test_1        | 	/usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000d02180)
        test_1        | 	/usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee3e00, 0x4055dd0)
        test_1        | 	/usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        | 	/usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0x1)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc000414290, 0x1, 0x1, 0x0, 0x0, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7b7e0, 0x26b1208, 0x13, 0x214629f, 0x4, 0xc000fd5028, 0x1, 0x1, 0xc000fd4f68, 0x43170b, ...)
        test_1        | 	/usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7b7e0, 0x26b1208, 0x13, 0xc000fd5028, 0x1, 0x1, 0xc00000f710, 0x1, 0x1)
        test_1        | 	/usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc00028bd60, 0x1e7b7e0, 0x26b1208, 0x13, 0x1e3c760, 0xc00000f698, 0x97, 0xc0004f94a0, 0x0, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc00052d500, 0xc00028bd60, 0x1e3c760, 0xc00000f698, 0x97, 0x1e3c760, 0xc00000f6b0, 0x97)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc00028bd60, 0x31bd258, 0x1e3c760, 0x1e3c760, 0xc00000f698, 0x97, 0x1e3c760, 0xc00000f6b0, 0x97, 0x7f9f093204a0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc00028bd60, 0x30d88d0, 0xc00035cfc0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3c760, 0xc00000f698, 0x1e3c760, 0xc00000f6b0, 0x438eb00, 0x7, 0x7, 0x6436805b8fa97d0d, 0x30d8c30)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc000414290, 0x1, 0x1, 0xc0004142b0, 0x1, 0x1, 0x1, 0x20)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc000fd5880, 0xc000fd5801, 0x2150c8b, 0xa, 0xc000fd5ab8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e1390, 0xc000d9aae0, 0x6fc23ac00, 0xc000fd5da0, 0x0, 0x0, 0xc000c37c00, 0x2aa, 0x1, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000d02180)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc000d02180, 0xc000c7c660)
        test_1        | 	/usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        | 	/usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 81d49bd3d2e8ee3da4a5800043b94aa174127ab7:

        test_1        | 
        test_1        | goroutine 130033 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee3e60, 0x4055dd0)
        test_1        | 	/usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000c28c00)
        test_1        | 	/usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee3e60, 0x4055dd0)
        test_1        | 	/usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        | 	/usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0x1)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc00044fa50, 0x1, 0x1, 0x0, 0x0, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7b840, 0x26b1298, 0x13, 0x21462ff, 0x4, 0xc001029028, 0x1, 0x1, 0xc001028f68, 0x43170b, ...)
        test_1        | 	/usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7b840, 0x26b1298, 0x13, 0xc001029028, 0x1, 0x1, 0xc000696708, 0x1, 0x1)
        test_1        | 	/usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc000286d20, 0x1e7b840, 0x26b1298, 0x13, 0x1e3c7c0, 0xc000696690, 0x97, 0xc000c4f860, 0x0, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc000779500, 0xc000286d20, 0x1e3c7c0, 0xc000696690, 0x97, 0x1e3c7c0, 0xc0006966a8, 0x97)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc000286d20, 0x31bd2f8, 0x1e3c7c0, 0x1e3c7c0, 0xc000696690, 0x97, 0x1e3c7c0, 0xc0006966a8, 0x97, 0x7ff5728613b8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc000286d20, 0x30d8970, 0xc000cb5640)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3c7c0, 0xc000696690, 0x1e3c7c0, 0xc0006966a8, 0x438eb00, 0x7, 0x7, 0x19ff45d5377496cb, 0x30d8cd0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc00044fa50, 0x1, 0x1, 0xc00044fa70, 0x1, 0x1, 0x1, 0x20)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc001029880, 0xc001029801, 0x2150cf5, 0xa, 0xc001029ab8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e1430, 0xc0002f9560, 0x6fc23ac00, 0xc001029da0, 0x0, 0x0, 0xc0004bec00, 0x320, 0x1, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000c28c00)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc000c28c00, 0xc000cb1890)
        test_1        | 	/usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        | 	/usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@rafiss rafiss self-assigned this Dec 8, 2021
@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 1bb94b40c519b775d99dffe64435f968206ced4b:

        test_1        | 
        test_1        | goroutine 605505 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee3e60, 0x4055dd0)
        test_1        | 	/usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc0003fea80)
        test_1        | 	/usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee3e60, 0x4055dd0)
        test_1        | 	/usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        | 	/usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0x1)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc000e5c020, 0x1, 0x1, 0x0, 0x0, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7b840, 0x26b1298, 0x13, 0x21462ff, 0x4, 0xc001101028, 0x1, 0x1, 0xc001100f68, 0x43170b, ...)
        test_1        | 	/usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7b840, 0x26b1298, 0x13, 0xc001101028, 0x1, 0x1, 0xc000e440c0, 0x1, 0x1)
        test_1        | 	/usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc000c960a0, 0x1e7b840, 0x26b1298, 0x13, 0x1e3c7c0, 0xc000e44000, 0x97, 0xc000e560a0, 0x0, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc000687500, 0xc000c960a0, 0x1e3c7c0, 0xc000e44000, 0x97, 0x1e3c7c0, 0xc000e44030, 0x97)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc000c960a0, 0x31bd2f8, 0x1e3c7c0, 0x1e3c7c0, 0xc000e44000, 0x97, 0x1e3c7c0, 0xc000e44030, 0x97, 0x7f3440c92ec8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc000c960a0, 0x30d8970, 0xc000b74040)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3c7c0, 0xc000e44000, 0x1e3c7c0, 0xc000e44030, 0x438eb00, 0x7, 0x7, 0x3d0d6d3571fdfc6f, 0x30d8cd0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc000e5c020, 0x1, 0x1, 0xc000e5c040, 0x1, 0x1, 0x1, 0x40)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc001101880, 0xc001101801, 0x2150ceb, 0xa, 0xc001101ab8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e1430, 0xc00108c840, 0x6fc23ac00, 0xc001101da0, 0x0, 0x0, 0xc000d62200, 0x18d, 0x1, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0003fea80)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc0003fea80, 0xc00079fe00)
        test_1        | 	/usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        | 	/usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ cb0222a1980b96ad59c181c96fab8340aa252571:

        test_1        | 
        test_1        | goroutine 6 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee4aa0, 0x4057dd0)
        test_1        | 	/usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc0003e9e00)
        test_1        | 	/usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee4aa0, 0x4057dd0)
        test_1        | 	/usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        | 	/usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0x1)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc0003c0850, 0x1, 0x1, 0x0, 0x0, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7c4e0, 0x26b2100, 0x13, 0x214707f, 0x4, 0xc0012db028, 0x1, 0x1, 0xc0012daf68, 0x43170b, ...)
        test_1        | 	/usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7c4e0, 0x26b2100, 0x13, 0xc0012db028, 0x1, 0x1, 0xc000c1c078, 0x1, 0x1)
        test_1        | 	/usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc000d5a000, 0x1e7c4e0, 0x26b2100, 0x13, 0x1e3d460, 0xc000c1c000, 0x97, 0xc000c3a280, 0x0, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc00059d540, 0xc000d5a000, 0x1e3d460, 0xc000c1c000, 0x97, 0x1e3d460, 0xc000c1c018, 0x97)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc000d5a000, 0x31be498, 0x1e3d460, 0x1e3d460, 0xc000c1c000, 0x97, 0x1e3d460, 0xc000c1c018, 0x97, 0x7fdcb776faa8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc000d5a000, 0x30d9b10, 0xc000b64080)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3d460, 0xc000c1c000, 0x1e3d460, 0xc000c1c018, 0x4390b80, 0x7, 0x7, 0x1e980f350b5ad105, 0x30d9e70)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc0003c0850, 0x1, 0x1, 0xc0003c0880, 0x1, 0x1, 0x1, 0x20)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc0012db880, 0xc0012db801, 0x2151a75, 0xa, 0xc0012dbab8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e25d0, 0xc000afef00, 0x6fc23ac00, 0xc0012dbda0, 0x0, 0x0, 0xc000af8c00, 0x1fb, 0x1, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0003e9e00)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc0003e9e00, 0xc000b50570)
        test_1        | 	/usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        | 	/usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Dec 10, 2021
Closed
@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 3cf7ac914c42bb024c688564983445f3eb5da58a:

        test_1        | 
        test_1        | goroutine 27 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee5a20, 0x4058dd0)
        test_1        | 	/usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000954780)
        test_1        | 	/usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee5a20, 0x4058dd0)
        test_1        | 	/usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        | 	/usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0xc0005650e0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc000b8bc40, 0x2, 0x2, 0x0, 0x0, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7d460, 0x26b3190, 0x13, 0x21480df, 0x4, 0xc0010d5028, 0x1, 0x1, 0xc0010d4f68, 0x43170b, ...)
        test_1        | 	/usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7d460, 0x26b3190, 0x13, 0xc0010d5028, 0x1, 0x1, 0xc000a219c8, 0x1, 0x1)
        test_1        | 	/usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc000d675e0, 0x1e7d460, 0x26b3190, 0x13, 0x1e3e3e0, 0xc000a21950, 0x97, 0xc0006c4af0, 0x0, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc000613540, 0xc000d675e0, 0x1e3e3e0, 0xc000a21950, 0x97, 0x1e3e3e0, 0xc000a21968, 0x97)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc000d675e0, 0x31bf5b8, 0x1e3e3e0, 0x1e3e3e0, 0xc000a21950, 0x97, 0x1e3e3e0, 0xc000a21968, 0x97, 0x7f6b20c3d4a0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc000d675e0, 0x30dac30, 0xc000be5d40)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3e3e0, 0xc000a21950, 0x1e3e3e0, 0xc000a21968, 0x4391b80, 0x7, 0x7, 0x1f156267b36c7212, 0x30daf90)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc000b8bc40, 0x2, 0x2, 0xc000b8bc60, 0x2, 0x2, 0x2, 0x20)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc0010d5880, 0xc0010d5801, 0x2152ad5, 0xa, 0xc0010d5ab8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e36f0, 0xc000111bc0, 0x6fc23ac00, 0xc0010d5da0, 0x0, 0x0, 0xc000e4f000, 0x3e3, 0x1, 0x0, ...)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000954780)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc000954780, 0xc00095c180)
        test_1        | 	/usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        | 	/usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ c754d101ccd7541b0f597dac2f37809c1a859bf2:

        postgres_1    | 		col_16367 NULLS FIRST,
        postgres_1    | 		col_16368 NULLS FIRST,
        postgres_1    | 		col_16369 NULLS FIRST,
        postgres_1    | 		col_16370 NULLS FIRST,
        postgres_1    | 		col_16371 NULLS FIRST,
        postgres_1    | 		col_16372 NULLS FIRST,
        postgres_1    | 		col_16373 NULLS FIRST,
        postgres_1    | 		col_16374 NULLS FIRST,
        postgres_1    | 		col_16375 NULLS FIRST
        test_1        | --- FAIL: TestCompare (621.98s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (17.26s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	nil,
        test_1        |             + 	string("BOX(-45 0,0 45)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('E':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_16390) AS tab_8434
        test_1        |             ORDER BY
        test_1        |             	CAST(col_16390 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('E'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_16390) AS tab_8434
        test_1        |             ORDER BY
        test_1        |             	CAST(col_16390 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ f963a1eb6daa99bd5fd2c43771773473cdf361f7:

        test_1        |             			JOIN postgres.public.table2@primary AS tab_417629 ON
        test_1        |             					(tab_417628.col4_8) = (tab_417629.crdb_internal_idx_expr_1)
        test_1        |             					AND (tab_417628.col4_2) = (tab_417629.crdb_internal_idx_expr_1)
        test_1        |             					AND (tab_417627.col4_2) = (tab_417629.col2_3)
        test_1        |             			JOIN postgres.public.table2@primary AS tab_417630
        test_1        |             				JOIN postgres.public.table2 AS tab_417631
        test_1        |             					JOIN postgres.public.table2 AS tab_417632 ON (tab_417631.col2_2) = (tab_417632.col2_2)
        test_1        |             					JOIN postgres.public.table2@table2_col2_2_col2_1_col2_3_col2_0_col2_5_col2_4_key AS tab_417633
        test_1        |             						JOIN postgres.public.table2@[0] AS tab_417634
        test_1        |             							JOIN postgres.public.table2@[0] AS tab_417635 ON (tab_417634.col2_4) = (tab_417635.col2_4)
        test_1        |             							JOIN postgres.public.table4 AS tab_417636
        test_1        |             								JOIN postgres.public.table4 AS tab_417637 ON
        test_1        |             										(tab_417636.col4_6) = (tab_417637.col4_6)
        test_1        |             										AND (tab_417636.col4_2) = (tab_417637.col4_2)
        test_1        |             										AND (tab_417636.col4_8) = (tab_417637.col4_8) ON
        test_1        |             									(tab_417635.crdb_internal_idx_expr_1) = (tab_417636.col4_8) ON
        test_1        |             								(tab_417633.crdb_internal_idx_expr) = (tab_417635.crdb_internal_idx_expr)
        test_1        |             								AND (tab_417633.col2_0) = (tab_417635.crdb_internal_idx_expr)
        test_1        |             								AND (tab_417633.col2_3) = (tab_417635.col2_3)
        test_1        |             								AND (tab_417633.col2_5) = (tab_417634.col2_5) ON
        test_1        |             							(tab_417632.col2_2) = (tab_417634.col2_2) ON
        test_1        |             						(tab_417630.col2_5) = (tab_417633.crdb_internal_idx_expr)
        test_1        |             						AND (tab_417630.col2_3) = (tab_417635.crdb_internal_idx_expr_1)
        test_1        |             						AND (tab_417630.col2_4) = (tab_417634.col2_4)
        test_1        |             						AND (tab_417630.col2_1) = (tab_417633.col2_1)
        test_1        |             						AND (tab_417630.col2_4) = (tab_417633.col2_1)
        test_1        |             						AND (tab_417630.crdb_internal_idx_expr) = (tab_417634.crdb_internal_idx_expr)
        test_1        |             						AND (tab_417630.col2_0) = (tab_417633.col2_0) ON
        test_1        |             					(tab_417626.col1_0) = (tab_417633.col2_5)
        test_1        |             					AND (tab_417629.col2_5) = (tab_417633.crdb_internal_idx_expr)
        test_1        |             					AND (tab_417628.col4_8) = (tab_417637.col4_8)
        test_1        |             					AND (tab_417626.col1_1) = (tab_417634.tableoid)
        test_1        |             		WHERE
        test_1        |             			true::BOOL
        test_1        |             	)
        test_1        |             		AS tab_417638
        test_1        |             ORDER BY
        test_1        |             	col_722735 NULLS FIRST, col_722736 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 3adc6da4ccdf80618e6bbcee5ee9e503a92517e7:

        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('f', 'whuhic', 'bo', 'cwnq', 'ifx');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('x', 'i');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:125: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        | 	panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 51 [running]:
        test_1        | testing.tRunner.func1.2(0x1fb8ac0, 0xc000cbe5e0)
        test_1        | 	/usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000603c80)
        test_1        | 	/usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1fb8ac0, 0xc000cbe5e0)
        test_1        | 	/usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x406df60, 0x31b8bd8, 0xc000dbd950, 0x31b8bd8, 0xc000dbd950, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:368 +0x5d3
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0xc000caa5d0, 0x406df60, 0x0, 0x0, 0x0, 0x0, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:301 +0x17f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc0004f6480)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:220 +0x9e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000caa5d0, 0xc000756640, 0x5, 0x5, 0x0, 0x0, 0x0, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:251 +0xbeb
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x26b38e0, 0xc000caa5d0, 0xc000756640, 0x5, 0x5, 0x0, 0xc0004aa320, 0xe0, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:97 +0x4e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc000caa5d0, 0x214a516, 0x5, 0x5, 0xc0005bfa30, 0x3, 0x3, 0xe0, 0x4436d7, 0x8)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:89 +0x163
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc000caa5d0, 0x5, 0x4, 0x0)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:91 +0x19e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000caa5d0, 0x4394f8, 0x30)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:77 +0x4f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0xc000caa5d0, 0xc45d5533c412c4b3, 0x11)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:43 +0x44
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000603c80)
        test_1        | 	/go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:127 +0x113
        test_1        | testing.tRunner(0xc000603c80, 0xc000caa570)
        test_1        | 	/usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        | 	/usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 999d35029f33a9b35dde0599c952efc83ed726a7:

        postgres_1    | 				postgres.public.table3 AS tab_29840
        postgres_1    | 			WHERE
        postgres_1    | 				false::BOOL
        postgres_1    | 			ORDER BY
        postgres_1    | 				tab_29840.crdb_internal_idx_expr ASC, tab_29840.crdb_internal_idx_expr
        postgres_1    | 		)
        postgres_1    | 			AS tab_29841
        postgres_1    | 	ORDER BY
        postgres_1    | 		col_43121 NULLS FIRST, col_43122 NULLS FIRST, col_43123 NULLS FIRST
        test_1        | --- FAIL: TestCompare (638.45s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (34.40s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	nil,
        test_1        |             + 	string("BOX(-90 0,-45 45)"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('D'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_43124) AS tab_29842
        test_1        |             ORDER BY
        test_1        |             	CAST(col_43124 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('D':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_43124) AS tab_29842
        test_1        |             ORDER BY
        test_1        |             	CAST(col_43124 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ f51352920c0af2bbede32dab8fee6424fc27a911:

        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (18.30s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	nil,
        test_1        |             + 	string("BOX(-180 45,-135 90)H"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			(st_box2dfromgeohash('B':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D::BOX2D || 'H':::STRING::STRING::STRING)::STRING
        test_1        |             				AS col_18185
        test_1        |             	)
        test_1        |             		AS tab_10018
        test_1        |             ORDER BY
        test_1        |             	col_18185 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			(st_box2dfromgeohash('B'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D::BOX2D || 'H'::TEXT::TEXT::TEXT)::TEXT
        test_1        |             				AS col_18185
        test_1        |             	)
        test_1        |             		AS tab_10018
        test_1        |             ORDER BY
        test_1        |             	col_18185 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 4d0b749d263b95baf3054607d5f13a92cbb6a055:

        postgres_1    | 2021-12-20 06:14:46.524 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2021-12-20 06:14:46.529 UTC [68] LOG:  database system was shut down at 2021-12-20 06:14:46 UTC
        postgres_1    | 2021-12-20 06:14:46.534 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2021-12-20 06:14:49.352 UTC [78] ERROR:  functions in index expression must be marked IMMUTABLE
        postgres_1    | 2021-12-20 06:14:49.352 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 TIMESTAMP NOT NULL, col1_1 INT2, col1_2 INT8 NULL, col1_3 NAME NOT NULL, col1_4 DATE, col1_5 BYTEA, col1_6 OID NULL, col1_7 INT8[] NOT NULL, col1_8 FLOAT4, col1_9 GEOGRAPHY, col1_10 REGPROCEDURE, col1_11 BOOL NULL, col1_12 DECIMAL NOT NULL, col1_13 NAME NOT NULL, col1_14 OID NULL, col1_15 BOX2D, col1_16 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_7 IS NULL THEN ''::TEXT ELSE e'Hf6\x11MIW'::TEXT END) STORED);
        postgres_1    | 	CREATE UNIQUE INDEX ON table1 (col1_1 ASC, col1_14);
        postgres_1    | 	CREATE UNIQUE INDEX ON table1 ((CASE WHEN col1_0 IS NULL THEN e'\x15\x1e\x05Q+2'::TEXT ELSE e'?sR\n!)s*'::TEXT END), col1_13, col1_1 ASC, col1_14 ASC, col1_10 DESC, col1_11 DESC) INCLUDE (col1_0, col1_3, col1_4, col1_5, col1_12);
        postgres_1    | 	CREATE TABLE table2 (col2_0 TEXT NOT NULL, col2_1 TIMESTAMPTZ NOT NULL, col2_2 REGROLE NOT NULL, col2_3 "char" NOT NULL, PRIMARY KEY (col2_3, col2_1, col2_0, col2_2));
        postgres_1    | 	CREATE INDEX ON table2 (col2_0 ASC, col2_3);
        postgres_1    | 	CREATE INDEX ON table2 (col2_0 ASC, col2_2 ASC, col2_1 ASC);
        postgres_1    | 	CREATE INDEX ON table2 (lower(CAST(col2_2 AS TEXT)) DESC, col2_0 ASC);
        postgres_1    | 	CREATE INDEX ON table2 (lower(col2_3) ASC, col2_2, lower(col2_0) ASC);
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('tok', 'k', 'w', 'icjc');
        postgres_1    | 	CREATE TYPE rand_typ_1 AS ENUM ('i', 'tia', 'nx', 'lftb', 'qqawsd', 'h');
        postgres_1    | 	CREATE TYPE rand_typ_2 AS ENUM ('ucmxf', 'xkg', 'ey', 'ijfj');
        postgres_1    | 	CREATE TYPE rand_typ_3 AS ENUM ('nsklw', 'zj', 'gtldxn', 'ybj', 'p');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (607.76s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (2.39s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 TIMESTAMP NOT NULL, col1_1 INT2, col1_2 INT8 NULL, col1_3 NAME NOT NULL, col1_4 DATE, col1_5 BYTEA, col1_6 OID NULL, col1_7 INT8[] NOT NULL, col1_8 FLOAT4, col1_9 GEOGRAPHY, col1_10 REGPROCEDURE, col1_11 BOOL NULL, col1_12 DECIMAL NOT NULL, col1_13 NAME NOT NULL, col1_14 OID NULL, col1_15 BOX2D, col1_16 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_7 IS NULL THEN ''::TEXT ELSE e'Hf6\x11MIW'::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_1 ASC, col1_14);
        test_1        |             CREATE UNIQUE INDEX ON table1 ((CASE WHEN col1_0 IS NULL THEN e'\x15\x1e\x05Q+2'::TEXT ELSE e'?sR\n!)s*'::TEXT END), col1_13, col1_1 ASC, col1_14 ASC, col1_10 DESC, col1_11 DESC) INCLUDE (col1_0, col1_3, col1_4, col1_5, col1_12);
        test_1        |             CREATE TABLE table2 (col2_0 TEXT NOT NULL, col2_1 TIMESTAMPTZ NOT NULL, col2_2 REGROLE NOT NULL, col2_3 "char" NOT NULL, PRIMARY KEY (col2_3, col2_1, col2_0, col2_2));
        test_1        |             CREATE INDEX ON table2 (col2_0 ASC, col2_3);
        test_1        |             CREATE INDEX ON table2 (col2_0 ASC, col2_2 ASC, col2_1 ASC);
        test_1        |             CREATE INDEX ON table2 (lower(CAST(col2_2 AS TEXT)) DESC, col2_0 ASC);
        test_1        |             CREATE INDEX ON table2 (lower(col2_3) ASC, col2_2, lower(col2_0) ASC);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('tok', 'k', 'w', 'icjc');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('i', 'tia', 'nx', 'lftb', 'qqawsd', 'h');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('ucmxf', 'xkg', 'ey', 'ijfj');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('nsklw', 'zj', 'gtldxn', 'ybj', 'p');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 33ec37ae94ff96d2f5804506810fb436b186bc32:

        postgres_1    | 2021-12-21 06:15:41.484 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2021-12-21 06:15:41.488 UTC [68] LOG:  database system was shut down at 2021-12-21 06:15:41 UTC
        postgres_1    | 2021-12-21 06:15:41.492 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2021-12-21 06:15:43.340 UTC [78] ERROR:  syntax error at or near "ASC" at character 773
        postgres_1    | 2021-12-21 06:15:43.340 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 OID, col1_1 TIMETZ NULL, col1_2 VARCHAR NOT NULL, col1_3 GEOMETRY NOT NULL, col1_4 FLOAT4 NULL, col1_5 CHAR NULL, col1_6 REGPROCEDURE NOT NULL, col1_7 REGCLASS NOT NULL, col1_8 REGROLE, col1_9 GEOGRAPHY NOT NULL, col1_10 DATE NULL, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_3 AS TEXT))) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_7 AS TEXT))) STORED, UNIQUE (col1_2), UNIQUE (col1_10));
        postgres_1    | 	CREATE TABLE table2 (col2_0 DECIMAL NOT NULL, col2_1 CHAR NULL, col2_2 NAME NOT NULL, col2_3 INET[], col2_4 INTERVAL NULL, col2_5 BIT(37) NOT NULL, col2_6 "char" NOT NULL, col2_7 TIMESTAMP, col2_8 OID, col2_9 REGCLASS NULL, col2_10 REGNAMESPACE NOT NULL, col2_11 DATE NULL, col2_12 OID NOT NULL, PRIMARY KEY (col2_2 ASC, col2_10 DESC, col2_6, col2_0 DESC, col2_12, col2_5 DESC), col2_13 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED, col2_14 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_11 AS TEXT))) STORED, col2_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col2_6)) STORED, UNIQUE (col2_5));
        postgres_1    | 	CREATE TABLE table3 (col3_0 DECIMAL NOT NULL, col3_1 GEOGRAPHY NOT NULL, col3_2 FLOAT4 NULL, col3_3 INET NOT NULL, UNIQUE (col3_2 DESC, (col3_0 + 2.473344391090436850E+29::DECIMAL) DESC) WHERE (table3.col3_0 != 1::DECIMAL) OR (table3.col3_2 <= '-Inf'::FLOAT8), UNIQUE (col3_0, lower(CAST(col3_1 AS TEXT)) ASC, col3_3), INVERTED INDEX (col3_1 DESC) WHERE (table3.col3_2 > 0.0::FLOAT8) AND (table3.col3_0 >= '-Infinity'::DECIMAL));
        postgres_1    | 	CREATE TABLE table4 (col4_0 BOOL[] NULL, col4_1 REGCLASS, col4_2 "char" NULL, col4_3 DATE NULL, col4_4 INTERVAL NULL, col4_5 BIT(40), col4_6 INET NOT NULL, col4_7 TEXT GENERATED ALWAYS AS (lower(CAST(col4_1 AS TEXT))) STORED, col4_8 TEXT GENERATED ALWAYS AS (lower(CAST(col4_5 AS TEXT))) STORED, UNIQUE (col4_7, lower(col4_2) ASC, col4_4 ASC, col4_3 DESC, col4_2, col4_1, col4_8 DESC, lower(col4_2)));
        postgres_1    | 	CREATE TABLE table5 (col5_0 DATE NOT NULL, col5_1 INT8, col5_2 INET NULL, col5_3 BOOL, col5_4 FLOAT8, col5_5 JSONB, col5_6 CHAR NOT NULL, col5_7 DATE NULL, col5_8 BOX2D, col5_9 TEXT GENERATED ALWAYS AS (lower(CAST(col5_3 AS TEXT))) STORED, col5_10 TEXT GENERATED ALWAYS AS (lower(CAST(col5_3 AS TEXT))) STORED);
        postgres_1    | 	ALTER TABLE table2 ADD FOREIGN KEY (col2_6) REFERENCES table1 (col1_2);
        postgres_1    | 	ALTER TABLE table4 ADD FOREIGN KEY (col4_5) REFERENCES table2 (col2_5) ON DELETE CASCADE;
        postgres_1    | 	ALTER TABLE table4 ADD FOREIGN KEY (col4_3) REFERENCES table1 (col1_10) ON DELETE RESTRICT;
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('ndoew', 'g', 'nefwvv', 'ngq');
        postgres_1    | 	CREATE TYPE rand_typ_1 AS ENUM ('nhvfz', 'zx');
        postgres_1    | 	CREATE TYPE rand_typ_2 AS ENUM ('n', 'c', 'f', 'qwwf');
        postgres_1    | 	CREATE TYPE rand_typ_3 AS ENUM ('qwvs');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (607.85s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.28s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 OID, col1_1 TIMETZ NULL, col1_2 VARCHAR NOT NULL, col1_3 GEOMETRY NOT NULL, col1_4 FLOAT4 NULL, col1_5 CHAR NULL, col1_6 REGPROCEDURE NOT NULL, col1_7 REGCLASS NOT NULL, col1_8 REGROLE, col1_9 GEOGRAPHY NOT NULL, col1_10 DATE NULL, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_3 AS TEXT))) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_7 AS TEXT))) STORED, UNIQUE (col1_2), UNIQUE (col1_10));
        test_1        |             CREATE TABLE table2 (col2_0 DECIMAL NOT NULL, col2_1 CHAR NULL, col2_2 NAME NOT NULL, col2_3 INET[], col2_4 INTERVAL NULL, col2_5 BIT(37) NOT NULL, col2_6 "char" NOT NULL, col2_7 TIMESTAMP, col2_8 OID, col2_9 REGCLASS NULL, col2_10 REGNAMESPACE NOT NULL, col2_11 DATE NULL, col2_12 OID NOT NULL, PRIMARY KEY (col2_2 ASC, col2_10 DESC, col2_6, col2_0 DESC, col2_12, col2_5 DESC), col2_13 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED, col2_14 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_11 AS TEXT))) STORED, col2_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col2_6)) STORED, UNIQUE (col2_5));
        test_1        |             CREATE TABLE table3 (col3_0 DECIMAL NOT NULL, col3_1 GEOGRAPHY NOT NULL, col3_2 FLOAT4 NULL, col3_3 INET NOT NULL, UNIQUE (col3_2 DESC, (col3_0 + 2.473344391090436850E+29::DECIMAL) DESC) WHERE (table3.col3_0 != 1::DECIMAL) OR (table3.col3_2 <= '-Inf'::FLOAT8), UNIQUE (col3_0, lower(CAST(col3_1 AS TEXT)) ASC, col3_3), INVERTED INDEX (col3_1 DESC) WHERE (table3.col3_2 > 0.0::FLOAT8) AND (table3.col3_0 >= '-Infinity'::DECIMAL));
        test_1        |             CREATE TABLE table4 (col4_0 BOOL[] NULL, col4_1 REGCLASS, col4_2 "char" NULL, col4_3 DATE NULL, col4_4 INTERVAL NULL, col4_5 BIT(40), col4_6 INET NOT NULL, col4_7 TEXT GENERATED ALWAYS AS (lower(CAST(col4_1 AS TEXT))) STORED, col4_8 TEXT GENERATED ALWAYS AS (lower(CAST(col4_5 AS TEXT))) STORED, UNIQUE (col4_7, lower(col4_2) ASC, col4_4 ASC, col4_3 DESC, col4_2, col4_1, col4_8 DESC, lower(col4_2)));
        test_1        |             CREATE TABLE table5 (col5_0 DATE NOT NULL, col5_1 INT8, col5_2 INET NULL, col5_3 BOOL, col5_4 FLOAT8, col5_5 JSONB, col5_6 CHAR NOT NULL, col5_7 DATE NULL, col5_8 BOX2D, col5_9 TEXT GENERATED ALWAYS AS (lower(CAST(col5_3 AS TEXT))) STORED, col5_10 TEXT GENERATED ALWAYS AS (lower(CAST(col5_3 AS TEXT))) STORED);
        test_1        |             ALTER TABLE table2 ADD FOREIGN KEY (col2_6) REFERENCES table1 (col1_2);
        test_1        |             ALTER TABLE table4 ADD FOREIGN KEY (col4_5) REFERENCES table2 (col2_5) ON DELETE CASCADE;
        test_1        |             ALTER TABLE table4 ADD FOREIGN KEY (col4_3) REFERENCES table1 (col1_10) ON DELETE RESTRICT;
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('ndoew', 'g', 'nefwvv', 'ngq');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('nhvfz', 'zx');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('n', 'c', 'f', 'qwwf');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('qwvs');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: syntax error at or near "ASC" (SQLSTATE 42601)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 2282896401079fef362d5456b71b32dd600e52b0:

        test_1        |             			'H':::STRING::STRING AS col_286789
        test_1        |             		FROM
        test_1        |             			postgres.public.table4@[0] AS tab_165167
        test_1        |             			JOIN postgres.public.table3 AS tab_165168
        test_1        |             				JOIN postgres.public.table3 AS tab_165169 ON (tab_165168.col3_0) = (tab_165169.col3_0)
        test_1        |             				JOIN postgres.public.table4@[0] AS tab_165170
        test_1        |             					JOIN postgres.public.table3@[0] AS tab_165171 ON (tab_165170.tableoid) = (tab_165171.col3_0)
        test_1        |             					JOIN postgres.public.table4@[0] AS tab_165172 ON (tab_165170.col4_10) = (tab_165172.col4_4) ON
        test_1        |             						(tab_165168.col3_2) = (tab_165172.col4_6) AND (tab_165169.col3_2) = (tab_165172.col4_6)
        test_1        |             				JOIN postgres.public.table3@[0] AS tab_165173 ON
        test_1        |             						(tab_165171.col3_2) = (tab_165173.col3_2)
        test_1        |             						AND (tab_165171.col3_3) = (tab_165173.col3_3)
        test_1        |             						AND (tab_165172.col4_1) = (tab_165173.col3_0)
        test_1        |             				JOIN postgres.public.table3@table3_col3_0_col3_2_col3_3_key AS tab_165174 ON
        test_1        |             						(tab_165171.col3_3) = (tab_165174.col3_2)
        test_1        |             						AND (tab_165172.tableoid) = (tab_165174.col3_0)
        test_1        |             						AND (tab_165171.col3_0) = (tab_165174.col3_0)
        test_1        |             				JOIN postgres.public.table5@table5_col5_3_col5_2_col5_8_expr_key AS tab_165175 ON
        test_1        |             						(tab_165173.col3_2) = (tab_165175.col5_0)
        test_1        |             						AND (tab_165169.col3_2) = (tab_165175.col5_0)
        test_1        |             						AND (tab_165174.col3_0) = (tab_165175.col5_1)
        test_1        |             						AND (tab_165168.col3_2) = (tab_165175.crdb_internal_idx_expr)
        test_1        |             						AND (tab_165170.col4_2) = (tab_165175.col5_5) ON
        test_1        |             					(tab_165167.col4_8) = (tab_165170.col4_9)
        test_1        |             					AND (tab_165167.col4_9) = (tab_165170.col4_8)
        test_1        |             					AND (tab_165167.col4_4) = (tab_165172.col4_8),
        test_1        |             			postgres.public.table4@[0] AS tab_165176
        test_1        |             		ORDER BY
        test_1        |             			tab_165167.col4_2 DESC, tab_165167.col4_4 ASC
        test_1        |             	)
        test_1        |             		AS tab_165177
        test_1        |             ORDER BY
        test_1        |             	col_286784 NULLS FIRST,
        test_1        |             	col_286785 NULLS FIRST,
        test_1        |             	col_286786 NULLS FIRST,
        test_1        |             	col_286787 NULLS FIRST,
        test_1        |             	col_286788 NULLS FIRST,
        test_1        |             	col_286789 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 147ca220b715dbaadef5a8689e1894feecda5358:

        postgres_1    | 	CREATE INDEX ON table1 (col1_1, lower(CAST(col1_6 AS TEXT)) ASC, col1_9 DESC, col1_7, col1_11, col1_2 ASC);
        postgres_1    | 	CREATE INDEX ON table1 (col1_9, col1_6 DESC, col1_10 ASC, col1_12, lower(CAST(col1_4 AS TEXT)), lower(CAST(col1_0 AS TEXT)) ASC, col1_7, col1_11 DESC, col1_1 ASC, col1_3 ASC, col1_4);
        postgres_1    | 	CREATE INDEX ON table1 (col1_5, col1_8 ASC, col1_11 ASC);
        postgres_1    | 	CREATE INDEX ON table1 (lower(CAST(col1_0 AS TEXT)) ASC, col1_7 DESC);
        postgres_1    | 	CREATE INDEX ON table1 (col1_3 ASC, col1_4 ASC, col1_6, col1_5 DESC, col1_2, col1_11 ASC, col1_12 ASC, col1_1, col1_10 ASC, col1_7 DESC, col1_9 ASC, col1_8 ASC);
        postgres_1    | 	CREATE INDEX ON table1 (col1_5 ASC, col1_1 ASC, col1_2 DESC);
        postgres_1    | 	CREATE TABLE table2 (col2_0 REGROLE NULL, col2_1 REGCLASS NULL, col2_2 INT2[], col2_3 TIME NULL, col2_4 INT8 NULL, col2_5 FLOAT8 NULL, col2_6 REGNAMESPACE NOT NULL, col2_7 REGROLE NULL, col2_8 CHAR NULL, col2_9 GEOGRAPHY, col2_10 REGROLE NOT NULL, col2_11 DECIMAL NOT NULL, col2_12 GEOGRAPHY NULL, col2_13 REGPROC NOT NULL, col2_14 INT8 NULL GENERATED ALWAYS AS (col2_4 + (-9022043841025872529)::INT8) STORED, col2_15 DECIMAL NOT NULL GENERATED ALWAYS AS (col2_11 + 54980389502053.99772::DECIMAL) STORED, col2_16 TEXT GENERATED ALWAYS AS (lower(CAST(col2_9 AS TEXT))) STORED, col2_17 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_6 IS NULL THEN 'LW'::TEXT ELSE '=ph/=SFiD'::TEXT END) STORED, col2_18 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN 'SY?X:'::TEXT ELSE 'U'::TEXT END) STORED);
        postgres_1    | 	CREATE TABLE table3 (col3_0 INT2 NULL, col3_1 GEOMETRY NOT NULL, col3_2 INT2 NULL GENERATED ALWAYS AS (col3_0 + 11822::INT8) STORED);
        postgres_1    | 	CREATE UNIQUE INDEX ON table3 (col3_0, col3_2);
        postgres_1    | 	CREATE UNIQUE INDEX ON table3 (col3_0 DESC);
        postgres_1    | 	CREATE INDEX ON table3 (lower(CAST(col3_1 AS TEXT)) ASC, col3_0 ASC);
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('djmsir', 'bvhqf', 'r', 'mmfxgz');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (608.26s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (5.14s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 BOX2D NOT NULL, col1_1 CHAR NOT NULL, col1_2 BOOL NOT NULL, col1_3 INET NOT NULL, col1_4 TIMESTAMP NOT NULL, col1_5 INTERVAL NOT NULL, col1_6 TIMETZ NOT NULL, PRIMARY KEY (col1_6, col1_3, col1_5, col1_4, col1_1, col1_2), col1_7 TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_1)) STORED, col1_8 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_4 IS NULL THEN e'\t{9'::TEXT ELSE e'q\x06*Sl'::TEXT END) STORED, col1_9 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED, col1_10 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_0 AS TEXT))) STORED, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table1 (col1_1 DESC, col1_9 DESC, col1_6 ASC, lower(CAST(col1_3 AS TEXT)) ASC, col1_3, col1_2 DESC, col1_11, col1_7 ASC, col1_10) INCLUDE (col1_0, col1_8);
        test_1        |             CREATE UNIQUE INDEX ON table1 ((CASE WHEN col1_4 IS NULL THEN '%y#Ie'::TEXT ELSE e'\x03\'\x05s'::TEXT END) ASC, col1_7, col1_10 ASC, col1_1 ASC, col1_3, col1_5, col1_9 DESC, col1_11 ASC, col1_12 ASC, col1_2 DESC, col1_6 ASC, col1_4, col1_8 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_11, col1_5, col1_4 ASC, col1_7 ASC, col1_1, col1_6 DESC, col1_10 ASC, col1_8 ASC, col1_3 ASC, col1_9, col1_12, lower(CAST(col1_2 AS TEXT)) DESC);
        test_1        |             CREATE INDEX ON table1 (col1_1, lower(CAST(col1_6 AS TEXT)) ASC, col1_9 DESC, col1_7, col1_11, col1_2 ASC);
        test_1        |             CREATE INDEX ON table1 (col1_9, col1_6 DESC, col1_10 ASC, col1_12, lower(CAST(col1_4 AS TEXT)), lower(CAST(col1_0 AS TEXT)) ASC, col1_7, col1_11 DESC, col1_1 ASC, col1_3 ASC, col1_4);
        test_1        |             CREATE INDEX ON table1 (col1_5, col1_8 ASC, col1_11 ASC);
        test_1        |             CREATE INDEX ON table1 (lower(CAST(col1_0 AS TEXT)) ASC, col1_7 DESC);
        test_1        |             CREATE INDEX ON table1 (col1_3 ASC, col1_4 ASC, col1_6, col1_5 DESC, col1_2, col1_11 ASC, col1_12 ASC, col1_1, col1_10 ASC, col1_7 DESC, col1_9 ASC, col1_8 ASC);
        test_1        |             CREATE INDEX ON table1 (col1_5 ASC, col1_1 ASC, col1_2 DESC);
        test_1        |             CREATE TABLE table2 (col2_0 REGROLE NULL, col2_1 REGCLASS NULL, col2_2 INT2[], col2_3 TIME NULL, col2_4 INT8 NULL, col2_5 FLOAT8 NULL, col2_6 REGNAMESPACE NOT NULL, col2_7 REGROLE NULL, col2_8 CHAR NULL, col2_9 GEOGRAPHY, col2_10 REGROLE NOT NULL, col2_11 DECIMAL NOT NULL, col2_12 GEOGRAPHY NULL, col2_13 REGPROC NOT NULL, col2_14 INT8 NULL GENERATED ALWAYS AS (col2_4 + (-9022043841025872529)::INT8) STORED, col2_15 DECIMAL NOT NULL GENERATED ALWAYS AS (col2_11 + 54980389502053.99772::DECIMAL) STORED, col2_16 TEXT GENERATED ALWAYS AS (lower(CAST(col2_9 AS TEXT))) STORED, col2_17 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_6 IS NULL THEN 'LW'::TEXT ELSE '=ph/=SFiD'::TEXT END) STORED, col2_18 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN 'SY?X:'::TEXT ELSE 'U'::TEXT END) STORED);
        test_1        |             CREATE TABLE table3 (col3_0 INT2 NULL, col3_1 GEOMETRY NOT NULL, col3_2 INT2 NULL GENERATED ALWAYS AS (col3_0 + 11822::INT8) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_0, col3_2);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_0 DESC);
        test_1        |             CREATE INDEX ON table3 (lower(CAST(col3_1 AS TEXT)) ASC, col3_0 ASC);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('djmsir', 'bvhqf', 'r', 'mmfxgz');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ ec9330f86763371c445acdc317088e24cbcbaac3:

        postgres_1    | 2021-12-24 06:15:44.532 UTC [50] LOG:  shutting down
        postgres_1    | 2021-12-24 06:15:44.631 UTC [48] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2021-12-24 06:15:44.749 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2021-12-24 06:15:44.749 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2021-12-24 06:15:44.749 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2021-12-24 06:15:44.753 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2021-12-24 06:15:44.758 UTC [67] LOG:  database system was shut down at 2021-12-24 06:15:44 UTC
        postgres_1    | 2021-12-24 06:15:44.763 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2021-12-24 06:15:46.216 UTC [77] ERROR:  syntax error at or near "(" at character 498
        postgres_1    | 2021-12-24 06:15:46.216 UTC [77] STATEMENT:  CREATE TABLE table1 (col1_0 GEOGRAPHY NOT NULL, col1_1 REGNAMESPACE, col1_2 REGCLASS, col1_3 INT4);
        postgres_1    | 	CREATE TABLE table2 (col2_0 REGROLE NOT NULL, col2_1 BOX2D NULL, col2_2 JSONB NULL, col2_3 GEOMETRY NULL, col2_4 OID, col2_5 TIMESTAMP NULL, col2_6 UUID NULL, col2_7 GEOMETRY, col2_8 BYTEA, col2_9 TIMETZ NOT NULL, col2_10 BOOL, col2_11 BIT(49) NOT NULL, col2_12 FLOAT8, col2_13 UUID, col2_14 TIMESTAMP, col2_15 FLOAT4 NOT NULL, col2_16 FLOAT4 GENERATED ALWAYS AS (col2_15 + col2_12) STORED, INDEX (col2_14) WHERE (((((((table2.col2_9 = '00:00:00+15:59:00'::TIMETZ) AND (table2.col2_15 > 1.0::FLOAT8)) OR (table2.col2_16 > 1.0::FLOAT8)) OR table2.col2_10) OR (table2.col2_14 = '0001-01-01 00:00:00'::TIMESTAMP)) OR (table2.col2_12 >= 1.7976931348623157e+308::FLOAT8)) AND (table2.col2_8 >= e'\\x27'::BYTEA)) AND (table2.col2_5 >= '-2000-01-01 00:00:00'::TIMESTAMP));
        postgres_1    | 	CREATE TABLE table3 (col3_0 REGPROC NOT NULL, col3_1 "char" NOT NULL, col3_2 TIMESTAMP NULL, col3_3 VARCHAR NULL, col3_4 "char" NULL, col3_5 BOX2D, col3_6 NAME NOT NULL, col3_7 JSONB, col3_8 INTERVAL NOT NULL, col3_9 TIMESTAMP NULL, col3_10 DATE NULL, col3_11 REGPROC, col3_12 REGPROCEDURE NULL, col3_13 GEOMETRY NOT NULL, col3_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_6)) STORED, col3_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_6)) STORED, col3_16 TEXT NULL GENERATED ALWAYS AS (lower(col3_4)) STORED, col3_17 TEXT GENERATED ALWAYS AS (lower(CAST(col3_7 AS TEXT))) STORED);
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('kfrlk', 'lbue');
        postgres_1    | 	CREATE TYPE rand_typ_1 AS ENUM ('wpij', 'pctfsr', 'jkcyc', 'db', 'cfp');
        postgres_1    | 	CREATE TYPE rand_typ_2 AS ENUM ('d', 'vjohj');
        postgres_1    | 	CREATE TYPE rand_typ_3 AS ENUM ('bjl', 'brlty', 'tl', 'vl', 'o', 'qyck');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (604.46s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (0.88s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 GEOGRAPHY NOT NULL, col1_1 REGNAMESPACE, col1_2 REGCLASS, col1_3 INT4);
        test_1        |             CREATE TABLE table2 (col2_0 REGROLE NOT NULL, col2_1 BOX2D NULL, col2_2 JSONB NULL, col2_3 GEOMETRY NULL, col2_4 OID, col2_5 TIMESTAMP NULL, col2_6 UUID NULL, col2_7 GEOMETRY, col2_8 BYTEA, col2_9 TIMETZ NOT NULL, col2_10 BOOL, col2_11 BIT(49) NOT NULL, col2_12 FLOAT8, col2_13 UUID, col2_14 TIMESTAMP, col2_15 FLOAT4 NOT NULL, col2_16 FLOAT4 GENERATED ALWAYS AS (col2_15 + col2_12) STORED, INDEX (col2_14) WHERE (((((((table2.col2_9 = '00:00:00+15:59:00'::TIMETZ) AND (table2.col2_15 > 1.0::FLOAT8)) OR (table2.col2_16 > 1.0::FLOAT8)) OR table2.col2_10) OR (table2.col2_14 = '0001-01-01 00:00:00'::TIMESTAMP)) OR (table2.col2_12 >= 1.7976931348623157e+308::FLOAT8)) AND (table2.col2_8 >= e'\\x27'::BYTEA)) AND (table2.col2_5 >= '-2000-01-01 00:00:00'::TIMESTAMP));
        test_1        |             CREATE TABLE table3 (col3_0 REGPROC NOT NULL, col3_1 "char" NOT NULL, col3_2 TIMESTAMP NULL, col3_3 VARCHAR NULL, col3_4 "char" NULL, col3_5 BOX2D, col3_6 NAME NOT NULL, col3_7 JSONB, col3_8 INTERVAL NOT NULL, col3_9 TIMESTAMP NULL, col3_10 DATE NULL, col3_11 REGPROC, col3_12 REGPROCEDURE NULL, col3_13 GEOMETRY NOT NULL, col3_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_6)) STORED, col3_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_6)) STORED, col3_16 TEXT NULL GENERATED ALWAYS AS (lower(col3_4)) STORED, col3_17 TEXT GENERATED ALWAYS AS (lower(CAST(col3_7 AS TEXT))) STORED);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('kfrlk', 'lbue');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('wpij', 'pctfsr', 'jkcyc', 'db', 'cfp');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('d', 'vjohj');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('bjl', 'brlty', 'tl', 'vl', 'o', 'qyck');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: syntax error at or near "(" (SQLSTATE 42601)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 2c4bb88e5318fe187e1bf6cb134b31bd63f63528:

        postgres_1    | 		(
        postgres_1    | 			SELECT
        postgres_1    | 				(NULL::GEOMETRY::GEOMETRY || tab_32733.col2_18::TEXT)::TEXT AS col_63396
        postgres_1    | 			FROM
        postgres_1    | 				postgres.public.table2 AS tab_32733
        postgres_1    | 		)
        postgres_1    | 			AS tab_32734
        postgres_1    | 	ORDER BY
        postgres_1    | 		col_63396 NULLS FIRST
        test_1        | --- FAIL: TestCompare (684.74s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (80.59s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	nil,
        test_1        |             + 	string("BOX(-135 45,-90 90)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('C':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_63659) AS tab_32879
        test_1        |             ORDER BY
        test_1        |             	CAST(col_63659 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('C'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_63659) AS tab_32879
        test_1        |             ORDER BY
        test_1        |             	CAST(col_63659 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ c22ac33a023323cb76fde367b766ef988d6e27f7:

        postgres_1    | 2021-12-30 06:16:31.524 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2021-12-30 06:16:34.609 UTC [78] ERROR:  functions in index expression must be marked IMMUTABLE
        postgres_1    | 2021-12-30 06:16:34.609 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 "char" NULL, col1_1 BYTEA, col1_2 REGPROC, col1_3 TEXT GENERATED ALWAYS AS (CASE WHEN col1_2 IS NULL THEN e'\x7fL\x1aH}EUyP'::TEXT ELSE e'ZI%6\x13w3h{'::TEXT END) STORED);
        postgres_1    | 	CREATE INDEX ON table1 ((CASE WHEN col1_1 IS NULL THEN e'\f'::TEXT ELSE '}n0-y7J'::TEXT END) ASC, lower(CAST(col1_2 AS TEXT)) ASC) INCLUDE (col1_2);
        postgres_1    | 	CREATE TABLE table2 (col2_0 CHAR NOT NULL, col2_1 GEOGRAPHY, col2_2 OID NULL, col2_3 REGPROC NOT NULL, col2_4 TIME, col2_5 BOOL NULL, col2_6 VARCHAR, col2_7 UUID NOT NULL, col2_8 TEXT[] NULL, col2_9 BYTEA NULL, col2_10 FLOAT8 NULL, col2_11 REGROLE, col2_12 BIT(11), col2_13 REGPROC NULL, col2_14 TEXT GENERATED ALWAYS AS (lower(CAST(col2_12 AS TEXT))) STORED, col2_15 TEXT GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED);
        postgres_1    | 	CREATE INDEX ON table2 (col2_15 ASC, col2_13, col2_9, col2_12 DESC, col2_5 ASC, col2_10 ASC, col2_4 DESC, col2_11) INCLUDE (col2_1, col2_2, col2_7);
        postgres_1    | 	CREATE UNIQUE INDEX ON table2 (col2_5 DESC, (CASE WHEN col2_8 IS NULL THEN 'c8Tb-'::TEXT ELSE e'^\x17Y\x19B!\tq$'::TEXT END), col2_6 DESC, col2_11, col2_7 DESC, col2_2, col2_12 ASC, col2_10 ASC, col2_9 DESC, col2_15 ASC) INCLUDE (col2_0, col2_3, col2_4);
        postgres_1    | 	CREATE UNIQUE INDEX ON table2 (col2_0);
        postgres_1    | 	CREATE UNIQUE INDEX ON table2 (col2_9, col2_2);
        postgres_1    | 	ALTER TABLE table1 ADD FOREIGN KEY (col1_0) REFERENCES table2 (col2_0) ON DELETE CASCADE ON UPDATE CASCADE;
        postgres_1    | 	ALTER TABLE table1 ADD FOREIGN KEY (col1_1, col1_2) REFERENCES table2 (col2_9, col2_2);
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('ur', 'nf', 'j', 'yiom', 'an');
        postgres_1    | 	CREATE TYPE rand_typ_1 AS ENUM ('xnoc', 'nthxum');
        postgres_1    | 	CREATE TYPE rand_typ_2 AS ENUM ('j', 'rrj', 'wupct', 'kiygk', 'tznppo');
        postgres_1    | 	CREATE TYPE rand_typ_3 AS ENUM ('xawf', 'uapx');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (604.81s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (2.80s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 "char" NULL, col1_1 BYTEA, col1_2 REGPROC, col1_3 TEXT GENERATED ALWAYS AS (CASE WHEN col1_2 IS NULL THEN e'\x7fL\x1aH}EUyP'::TEXT ELSE e'ZI%6\x13w3h{'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table1 ((CASE WHEN col1_1 IS NULL THEN e'\f'::TEXT ELSE '}n0-y7J'::TEXT END) ASC, lower(CAST(col1_2 AS TEXT)) ASC) INCLUDE (col1_2);
        test_1        |             CREATE TABLE table2 (col2_0 CHAR NOT NULL, col2_1 GEOGRAPHY, col2_2 OID NULL, col2_3 REGPROC NOT NULL, col2_4 TIME, col2_5 BOOL NULL, col2_6 VARCHAR, col2_7 UUID NOT NULL, col2_8 TEXT[] NULL, col2_9 BYTEA NULL, col2_10 FLOAT8 NULL, col2_11 REGROLE, col2_12 BIT(11), col2_13 REGPROC NULL, col2_14 TEXT GENERATED ALWAYS AS (lower(CAST(col2_12 AS TEXT))) STORED, col2_15 TEXT GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table2 (col2_15 ASC, col2_13, col2_9, col2_12 DESC, col2_5 ASC, col2_10 ASC, col2_4 DESC, col2_11) INCLUDE (col2_1, col2_2, col2_7);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_5 DESC, (CASE WHEN col2_8 IS NULL THEN 'c8Tb-'::TEXT ELSE e'^\x17Y\x19B!\tq$'::TEXT END), col2_6 DESC, col2_11, col2_7 DESC, col2_2, col2_12 ASC, col2_10 ASC, col2_9 DESC, col2_15 ASC) INCLUDE (col2_0, col2_3, col2_4);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_9, col2_2);
        test_1        |             ALTER TABLE table1 ADD FOREIGN KEY (col1_0) REFERENCES table2 (col2_0) ON DELETE CASCADE ON UPDATE CASCADE;
        test_1        |             ALTER TABLE table1 ADD FOREIGN KEY (col1_1, col1_2) REFERENCES table2 (col2_9, col2_2);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('ur', 'nf', 'j', 'yiom', 'an');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('xnoc', 'nthxum');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('j', 'rrj', 'wupct', 'kiygk', 'tznppo');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('xawf', 'uapx');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ dc72c17f280dc20fa59970209c0e975e4072f91e:

        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			3::OID::OID AS col_242312,
        test_1        |             			tab_125396.col1_3 AS col_242313,
        test_1        |             			tab_125396.col1_4 AS col_242314,
        test_1        |             			tab_125396.col1_11 AS col_242315,
        test_1        |             			tab_125396.col1_12 AS col_242316,
        test_1        |             			tab_125396.col1_2 AS col_242317,
        test_1        |             			(tab_125396.col1_6::INET[] || '::/0'::INET::INET::INET)::INET[] AS col_242318
        test_1        |             		FROM
        test_1        |             			(
        test_1        |             				VALUES
        test_1        |             					(NULL::TIMESTAMPTZ),
        test_1        |             					('2000-01-01 07:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ),
        test_1        |             					('2000-01-01 02:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ),
        test_1        |             					('2000-01-01 08:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ),
        test_1        |             					('2000-01-01 07:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ)
        test_1        |             			)
        test_1        |             				AS tab_125395 (col_242311)
        test_1        |             			LEFT JOIN postgres.public.table1 AS tab_125396 ON NULL::BOOL
        test_1        |             		WHERE
        test_1        |             			true::BOOL
        test_1        |             		ORDER BY
        test_1        |             			tab_125396.col1_7,
        test_1        |             			tab_125395.col_242311 ASC,
        test_1        |             			tab_125396.col1_4 DESC,
        test_1        |             			tab_125396.col1_2 DESC,
        test_1        |             			tab_125396.col1_3
        test_1        |             	)
        test_1        |             		AS tab_125397
        test_1        |             ORDER BY
        test_1        |             	col_242312 NULLS FIRST,
        test_1        |             	col_242313 NULLS FIRST,
        test_1        |             	col_242314 NULLS FIRST,
        test_1        |             	col_242315 NULLS FIRST,
        test_1        |             	col_242316 NULLS FIRST,
        test_1        |             	col_242317 NULLS FIRST,
        test_1        |             	col_242318 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ fb88f951323864fafd104e132cbf1f2f22f2e3ac:

        postgres_1    | 				st_relatematch('C'::TEXT::TEXT::TEXT, 'D'::TEXT::TEXT::TEXT)::BOOL
        postgres_1    | 			GROUP BY
        postgres_1    | 				tab_29169.col4_1, tab_29169.col4_0
        postgres_1    | 			ORDER BY
        postgres_1    | 				tab_29169.col4_1 ASC, tab_29169.col4_0 DESC
        postgres_1    | 		)
        postgres_1    | 			AS tab_29170
        postgres_1    | 	ORDER BY
        postgres_1    | 		col_43080 NULLS FIRST
        test_1        | --- FAIL: TestCompare (649.40s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (45.96s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare postgres to cockroach1:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	string("BOX(0 -90,45 -45)"),
        test_1        |             + 	nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('H':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_43188) AS tab_29244
        test_1        |             ORDER BY
        test_1        |             	CAST(col_43188 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('H'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_43188) AS tab_29244
        test_1        |             ORDER BY
        test_1        |             	CAST(col_43188 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 0c8df44947208da2f6234d2736e8ab6d3b0937c0:

        test_1        |             									(
        test_1        |             										VALUES
        test_1        |             											('01:33:22.376917':::TIME),
        test_1        |             											('04:03:27.172455':::TIME),
        test_1        |             											('18:38:45.555543':::TIME)
        test_1        |             									)
        test_1        |             										AS tab_176813 (col_258104)
        test_1        |             							)
        test_1        |             					SELECT
        test_1        |             						tab_176810.col1_3::INT8 AS col_258105
        test_1        |             					FROM
        test_1        |             						postgres.public.table2@table2_col2_0_idx1 AS tab_176814
        test_1        |             					WHERE
        test_1        |             						true
        test_1        |             				)
        test_1        |             	)
        test_1        |             		AS tab_176815
        test_1        |             ORDER BY
        test_1        |             	col_258106 NULLS FIRST,
        test_1        |             	col_258107 NULLS FIRST,
        test_1        |             	col_258108 NULLS FIRST,
        test_1        |             	col_258109 NULLS FIRST,
        test_1        |             	col_258110 NULLS FIRST,
        test_1        |             	col_258111 NULLS FIRST,
        test_1        |             	col_258112 NULLS FIRST,
        test_1        |             	col_258113 NULLS FIRST,
        test_1        |             	col_258114 NULLS FIRST,
        test_1        |             	col_258115 NULLS FIRST,
        test_1        |             	col_258116 NULLS FIRST,
        test_1        |             	col_258117 NULLS FIRST,
        test_1        |             	col_258118 NULLS FIRST,
        test_1        |             	col_258119 NULLS FIRST,
        test_1        |             	col_258120 NULLS FIRST,
        test_1        |             	col_258121 NULLS FIRST,
        test_1        |             	col_258122 NULLS FIRST,
        test_1        |             	col_258123 NULLS FIRST,
        test_1        |             	col_258124 NULLS FIRST,
        test_1        |             	col_258125 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 12c606395dc2cfb35bd82972ab65c4453f33c400:

        test_1        |             					JOIN postgres.public.table1@[0] AS tab_196483
        test_1        |             						JOIN postgres.public.table1@[0] AS tab_196484
        test_1        |             							JOIN postgres.public.table1@primary AS tab_196485 ON
        test_1        |             									(tab_196484.col1_11) = (tab_196485.col1_12) ON
        test_1        |             								(tab_196483.col1_5) = (tab_196485.col1_5) ON
        test_1        |             							(tab_196482.col1_12) = (tab_196485.col1_14) ON
        test_1        |             						(tab_196478.col1_12) = (tab_196485.col1_12)
        test_1        |             						AND (tab_196478.tableoid) = (tab_196484.tableoid)
        test_1        |             						AND (tab_196478.col1_12) = (tab_196481.col1_11)
        test_1        |             						AND (tab_196478.col1_9) = (tab_196481.col1_9) ON
        test_1        |             					(tab_196477.col1_14) = (tab_196478.col1_13)
        test_1        |             					AND (tab_196477.col1_7) = (tab_196483.col1_7)
        test_1        |             					AND (tab_196477.col1_13) = (tab_196483.col1_13),
        test_1        |             			postgres.public.table1@[0] AS tab_196486
        test_1        |             		ORDER BY
        test_1        |             			tab_196478.col1_1,
        test_1        |             			tab_196484.col1_1 ASC,
        test_1        |             			tab_196478.crdb_internal_mvcc_timestamp DESC,
        test_1        |             			tab_196482.col1_0 ASC
        test_1        |             	)
        test_1        |             		AS tab_196487
        test_1        |             ORDER BY
        test_1        |             	col_340147 NULLS FIRST,
        test_1        |             	col_340148 NULLS FIRST,
        test_1        |             	col_340149 NULLS FIRST,
        test_1        |             	col_340150 NULLS FIRST,
        test_1        |             	col_340151 NULLS FIRST,
        test_1        |             	col_340152 NULLS FIRST,
        test_1        |             	col_340153 NULLS FIRST,
        test_1        |             	col_340154 NULLS FIRST,
        test_1        |             	col_340155 NULLS FIRST,
        test_1        |             	col_340156 NULLS FIRST,
        test_1        |             	col_340157 NULLS FIRST,
        test_1        |             	col_340158 NULLS FIRST,
        test_1        |             	col_340159 NULLS FIRST,
        test_1        |             	col_340160 NULLS FIRST,
        test_1        |             	col_340161 NULLS FIRST,
        test_1        |             	col_340162 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 53b90e9cf9406aea7477d99a1ba40e9cc3c29015:

        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('ocy', 'epcr', 'e', 'jjth', 'ksoi');
        postgres_1    | 	CREATE TYPE rand_typ_1 AS ENUM ('gawqdt', 'pp');
        postgres_1    | 	CREATE TYPE rand_typ_2 AS ENUM ('qzqql');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (610.72s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (5.88s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 INT2, col1_1 REGPROC, col1_2 OID NOT NULL, col1_3 FLOAT4 NOT NULL, col1_4 NAME NULL, col1_5 CHAR NULL, col1_6 REGPROC NULL, col1_7 DECIMAL, col1_8 BOOL NOT NULL GENERATED ALWAYS AS (true) STORED, col1_9 FLOAT4 NOT NULL GENERATED ALWAYS AS (col1_3 + 0.2714773416519165::FLOAT8) STORED, col1_10 DECIMAL GENERATED ALWAYS AS (col1_7 + 1.408948199274609621E+35::DECIMAL) STORED, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_2 AS TEXT))) STORED, col1_12 INT2 GENERATED ALWAYS AS (col1_0 + (-23585)::INT8) STORED, col1_13 TEXT NULL GENERATED ALWAYS AS (lower(col1_4)) STORED, col1_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_2 AS TEXT))) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_2, col1_6 ASC, col1_0 DESC, col1_7 ASC, col1_3, col1_5 ASC, lower(col1_4)) INCLUDE (col1_4, col1_10, col1_11, col1_13);
        test_1        |             CREATE INDEX ON table1 (col1_4, col1_11 DESC, col1_9 DESC, col1_6 DESC, col1_12 DESC, col1_10 ASC, col1_8 DESC, col1_1 DESC, col1_14 ASC);
        test_1        |             CREATE INDEX ON table1 (col1_13 ASC, col1_0 DESC, col1_1 DESC, col1_10 DESC, col1_4, col1_8, col1_3 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_8 ASC, col1_2, col1_11 DESC, col1_12 ASC, col1_9 ASC) INCLUDE (col1_3, col1_4, col1_6, col1_7, col1_10, col1_13);
        test_1        |             CREATE INDEX ON table1 (col1_14, col1_4 DESC, col1_0 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_11 DESC, col1_1 DESC, col1_0, col1_10, col1_5 ASC, col1_14 DESC, col1_9, col1_2 ASC, col1_7 ASC, col1_8, col1_13, col1_4 DESC, col1_6 ASC, col1_3, col1_12);
        test_1        |             CREATE INDEX ON table1 (col1_6 ASC, col1_10 DESC) INCLUDE (col1_0, col1_1, col1_4, col1_5, col1_9, col1_11);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_7 DESC, col1_12 DESC, (true) ASC, col1_1 DESC, col1_8 DESC, col1_3, lower(col1_4) ASC, col1_6 DESC);
        test_1        |             CREATE TABLE table2 (col2_0 DATE NULL, col2_1 REGPROCEDURE NOT NULL, col2_2 "char" NULL, col2_3 BOX2D NOT NULL, col2_4 TEXT, PRIMARY KEY (col2_1), col2_5 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_3 AS TEXT))) STORED, col2_6 TEXT GENERATED ALWAYS AS (lower(col2_4)) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_1 DESC, col2_5 DESC, col2_0, col2_6 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 ((true) DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 ((CASE WHEN col2_1 IS NULL THEN e'J^\x0b\f;'::TEXT ELSE e'DH\x15cY\'\tl'::TEXT END), col2_4, col2_5 ASC);
        test_1        |             CREATE INDEX ON table2 (col2_5, col2_1, col2_6 DESC, col2_0);
        test_1        |             CREATE INDEX ON table2 (col2_0 DESC, col2_4 DESC, col2_6 ASC, lower(col2_4) DESC);
        test_1        |             CREATE TABLE table3 (col3_0 INET NOT NULL, col3_1 REGPROCEDURE, col3_2 BIT(18) NULL, col3_3 GEOMETRY NOT NULL, col3_4 REGTYPE NULL, col3_5 FLOAT4 NOT NULL, col3_6 TIMESTAMPTZ NOT NULL, col3_7 BIT(34), col3_8 BOX2D NULL, col3_9 UUID NOT NULL, col3_10 BOOL NULL, col3_11 DECIMAL NOT NULL, col3_12 GEOMETRY NOT NULL, col3_13 BYTEA NOT NULL, col3_14 TIMESTAMP NOT NULL, col3_15 INT2 NOT NULL, col3_16 BOX2D, col3_17 INTERVAL, col3_18 INT2 NOT NULL GENERATED ALWAYS AS (col3_15 + 10346::INT8) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_15 DESC, col3_2 DESC, lower(CAST(col3_16 AS TEXT)) ASC, col3_13 DESC, lower(CAST(col3_12 AS TEXT)), col3_9);
        test_1        |             CREATE UNIQUE INDEX ON table3 (lower(CAST(col3_3 AS TEXT)), lower(CAST(col3_7 AS TEXT)), col3_6 DESC, (CASE WHEN col3_4 IS NULL THEN 'OgZs SN'::TEXT ELSE e'r\x17\x07\x04f'::TEXT END)) INCLUDE (col3_0, col3_3, col3_5, col3_7, col3_12, col3_13, col3_16, col3_18);
        test_1        |             CREATE TABLE table4 (col4_0 CHAR, col4_1 REGNAMESPACE, col4_2 REGPROCEDURE NOT NULL, col4_3 REGCLASS, col4_4 BOX2D[], col4_5 TEXT, col4_6 FLOAT4 NOT NULL, col4_7 UUID NULL, col4_8 BOOL NULL, col4_9 BOOL NOT NULL, col4_10 "char" NULL, PRIMARY KEY (col4_6, col4_2, col4_9), col4_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col4_2 IS NULL THEN e'\x0bTh'::TEXT ELSE e'K\x05*]mn'::TEXT END) STORED, col4_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_9 AS TEXT))) STORED, col4_13 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col4_2 IS NULL THEN e'F\x0bUa``'::TEXT ELSE '336'::TEXT END) STORED, col4_14 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col4_8 AS TEXT))) STORED, col4_15 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col4_7 AS TEXT))) STORED, col4_16 TEXT GENERATED ALWAYS AS (CASE WHEN col4_1 IS NULL THEN '1~'::TEXT ELSE e'k0&\x03"\x02}'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table4 (col4_11 DESC, col4_16 DESC, col4_2 ASC, (CASE WHEN col4_4 IS NULL THEN e'\x00'::TEXT ELSE e'}\\OL'::TEXT END) DESC, col4_15 DESC, col4_8 ASC, col4_5 DESC, col4_9 ASC, col4_12, col4_3, col4_13 DESC, col4_14 ASC, col4_1, col4_6 DESC, col4_10 ASC, col4_0);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_13, col4_12) INCLUDE (col4_1, col4_3, col4_8, col4_10, col4_11);
        test_1        |             CREATE INDEX ON table4 (col4_12 DESC, col4_0 DESC, col4_1 ASC, col4_14 DESC, col4_6, col4_13, col4_8, col4_5 ASC, col4_7 ASC) INCLUDE (col4_3, col4_10, col4_11, col4_15);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('ocy', 'epcr', 'e', 'jjth', 'ksoi');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('gawqdt', 'pp');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('qzqql');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ ceda784bb77b45634fe980278437a872dc8f9a88:

        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (170.64s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	string("2000-01-01 07:59:57+00:00E"),
        test_1        |             + 	string("2000-01-01 07:59:57+00E"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			(('2000-01-01 08:00:00+00:00':::TIMESTAMPTZ::TIMESTAMPTZ::TIMESTAMPTZ - '00:00:03':::INTERVAL::INTERVAL::INTERVAL)::TIMESTAMPTZ::TIMESTAMPTZ || 'E':::STRING::STRING::STRING)::STRING
        test_1        |             				AS col_147741
        test_1        |             	)
        test_1        |             		AS tab_73822
        test_1        |             ORDER BY
        test_1        |             	col_147741 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			(('2000-01-01 08:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ::TIMESTAMPTZ - '00:00:03'::INTERVAL::INTERVAL::INTERVAL)::TIMESTAMPTZ::TIMESTAMPTZ || 'E'::TEXT::TEXT::TEXT)::TEXT
        test_1        |             				AS col_147741
        test_1        |             	)
        test_1        |             		AS tab_73822
        test_1        |             ORDER BY
        test_1        |             	col_147741 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 5c5501092e833d2a10d1351f8b4f4b2dc83e95a8:

        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (20.79s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare postgres to cockroach1:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	string("BOX(0 -90,45 -45)"),
        test_1        |             + 	nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			st_box2dfromgeohash(COALESCE('H':::STRING::STRING, 'I':::STRING::STRING)::STRING, NULL::INT4::INT4)::BOX2D
        test_1        |             				AS col_24930
        test_1        |             	)
        test_1        |             		AS tab_13186
        test_1        |             ORDER BY
        test_1        |             	CAST(col_24930 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			st_box2dfromgeohash(COALESCE('H'::TEXT::TEXT, 'I'::TEXT::TEXT)::TEXT, NULL::INT4::INT4)::BOX2D
        test_1        |             				AS col_24930
        test_1        |             	)
        test_1        |             		AS tab_13186
        test_1        |             ORDER BY
        test_1        |             	CAST(col_24930 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ dbc00104d9d95d3d6c793895091915a56d0e08ea:

        postgres_1    | 	CREATE UNIQUE INDEX ON table2 (col2_1 ASC, col2_0 ASC, col2_8 ASC);
        postgres_1    | 	CREATE UNIQUE INDEX ON table2 (col2_1);
        postgres_1    | 	CREATE TABLE table3 (col3_0 OID NULL, col3_1 BIT(35) NOT NULL, col3_2 TIMESTAMPTZ, col3_3 REGCLASS NOT NULL, col3_4 JSONB NULL, col3_5 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col3_1 AS TEXT))) STORED);
        postgres_1    | 	CREATE INDEX ON table3 (col3_0 DESC);
        postgres_1    | 	CREATE UNIQUE INDEX ON table3 (col3_5, col3_0, lower(CAST(col3_0 AS TEXT)), col3_3);
        postgres_1    | 	ALTER TABLE table1 ADD FOREIGN KEY (col1_0) REFERENCES table2 (col2_1);
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('yphyl', 'bi', 'bzb', 'kfz', 'a', 'rzsr');
        postgres_1    | 	CREATE TYPE rand_typ_1 AS ENUM ('jjtpso', 'nrqd', 'gxfh');
        postgres_1    | 	CREATE TYPE rand_typ_2 AS ENUM ('szy', 'fpg', 'h', 'hvnc', 'irapy');
        postgres_1    | 	CREATE TYPE rand_typ_3 AS ENUM ('zhcgtk', 'lop', 'rrqr', 'zo');
        postgres_1    | 	CREATE TYPE rand_typ_4 AS ENUM ('bxpmum', 'dk');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (607.39s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (3.22s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 CHAR NOT NULL, PRIMARY KEY (col1_0));
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_0 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_0 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_0 ASC);
        test_1        |             CREATE TABLE table2 (col2_0 REGROLE NOT NULL, col2_1 "char" NOT NULL, col2_2 BOX2D NOT NULL, col2_3 JSONB NOT NULL, col2_4 BIT(15) NOT NULL, col2_5 JSONB NULL, col2_6 TIMESTAMP NOT NULL, col2_7 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_6 IS NULL THEN e'\x7fm\x15]'::TEXT ELSE e'\''::TEXT END) STORED, col2_8 BOOL NOT NULL GENERATED ALWAYS AS (true) STORED, col2_9 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_5 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table2 (col2_6 ASC, col2_7 DESC, lower(CAST(col2_4 AS TEXT)), col2_4) INCLUDE (col2_1, col2_5, col2_9);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_1 ASC, col2_0 ASC, col2_8 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_1);
        test_1        |             CREATE TABLE table3 (col3_0 OID NULL, col3_1 BIT(35) NOT NULL, col3_2 TIMESTAMPTZ, col3_3 REGCLASS NOT NULL, col3_4 JSONB NULL, col3_5 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col3_1 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table3 (col3_0 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_5, col3_0, lower(CAST(col3_0 AS TEXT)), col3_3);
        test_1        |             ALTER TABLE table1 ADD FOREIGN KEY (col1_0) REFERENCES table2 (col2_1);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('yphyl', 'bi', 'bzb', 'kfz', 'a', 'rzsr');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('jjtpso', 'nrqd', 'gxfh');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('szy', 'fpg', 'h', 'hvnc', 'irapy');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('zhcgtk', 'lop', 'rrqr', 'zo');
        test_1        |             CREATE TYPE rand_typ_4 AS ENUM ('bxpmum', 'dk');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: foreign key constraint "table1_col1_0_fkey" cannot be implemented (SQLSTATE 42804)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 09c8f05a9cb713b8bddffa03d0e322e8f2caf73b:

        postgres_1    | 		col_279978 NULLS FIRST,
        postgres_1    | 		col_279979 NULLS FIRST,
        postgres_1    | 		col_279980 NULLS FIRST,
        postgres_1    | 		col_279981 NULLS FIRST,
        postgres_1    | 		col_279982 NULLS FIRST,
        postgres_1    | 		col_279983 NULLS FIRST,
        postgres_1    | 		col_279984 NULLS FIRST
        test_1        | --- FAIL: TestCompare (866.55s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (262.59s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	string("E::"),
        test_1        |             + 	string("E::/128"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT ('E'::TEXT::TEXT::TEXT || netmask('::2/0'::INET::INET::INET)::INET::INET)::TEXT AS col_280572)
        test_1        |             		AS tab_160484
        test_1        |             ORDER BY
        test_1        |             	col_280572 NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT ('E':::STRING::STRING::STRING || netmask('::2/0':::INET::INET::INET)::INET::INET)::STRING AS col_280572)
        test_1        |             		AS tab_160484
        test_1        |             ORDER BY
        test_1        |             	col_280572 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Oct 5, 2022
Closed
@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 7ab6df782e11a5d86d4286ea53d5872cd3ccd173:

        test_1        |             - 				Exp:    -16,
        test_1        |             + 				Exp:    -17,
        test_1        |               				Status: 2,
        test_1        |               				NaN:    false,
        test_1        |               			},
        test_1        |               		},
        test_1        |               		Dimensions: {{Length: 1, LowerBound: 1}},
        test_1        |               		Status:     2,
        test_1        |               	},
        test_1        |               	[16]uint8{0x00, 0x00, 0x00, 0x00, ...},
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			(NULL::DECIMAL[]::DECIMAL[] || ((4::DECIMAL::DECIMAL::DECIMAL ^ 5::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL / 6::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL[]
        test_1        |             				AS col_102852,
        test_1        |             			'00000000-0000-0000-0000-000000000005'::UUID::UUID AS col_102853
        test_1        |             	)
        test_1        |             		AS tab_60792
        test_1        |             ORDER BY
        test_1        |             	col_102852 NULLS FIRST, col_102853 NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			(NULL::DECIMAL[]::DECIMAL[] || ((4:::DECIMAL::DECIMAL::DECIMAL ^ 5:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL / 6:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL[]
        test_1        |             				AS col_102852,
        test_1        |             			'00000000-0000-0000-0000-000000000005':::UUID::UUID AS col_102853
        test_1        |             	)
        test_1        |             		AS tab_60792
        test_1        |             ORDER BY
        test_1        |             	col_102852 NULLS FIRST, col_102853 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 88b9136dc538455ed0f61cada4993625064acbaf:

        postgres_1    | 	CREATE UNIQUE INDEX ON table2 (col2_2, col2_7, col2_9, col2_8 DESC) INCLUDE (col2_0, col2_5, col2_6);
        postgres_1    | 	CREATE UNIQUE INDEX ON table2 (col2_7 ASC, col2_1 DESC, col2_3, col2_4 ASC, col2_9, col2_5, (true));
        postgres_1    | 	CREATE TABLE table3 (col3_0 FLOAT4 NOT NULL, col3_1 INET NULL, col3_2 GEOMETRY, col3_3 DECIMAL NULL, col3_4 BOOL NULL, col3_5 TIME NULL, col3_6 JSONB NULL, col3_7 DECIMAL NULL, col3_8 DECIMAL NULL GENERATED ALWAYS AS (col3_7 + col3_3) STORED, col3_9 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col3_1 AS TEXT))) STORED);
        postgres_1    | 	CREATE UNIQUE INDEX ON table3 (col3_5 ASC, col3_0 ASC) INCLUDE (col3_2, col3_3, col3_4, col3_7);
        postgres_1    | 	CREATE UNIQUE INDEX ON table3 (col3_3 DESC, col3_8 ASC, col3_1 ASC) INCLUDE (col3_2, col3_4, col3_5, col3_6);
        postgres_1    | 	CREATE INDEX ON table3 (col3_4 ASC, col3_0 ASC);
        postgres_1    | 	CREATE TABLE table4 (col4_0 INT8 NOT NULL, PRIMARY KEY (col4_0));
        postgres_1    | 	CREATE TABLE table5 (col5_0 INET, col5_1 REGNAMESPACE, col5_2 TIME, col5_3 DATE NOT NULL, col5_4 INT8 NOT NULL, col5_5 REGCLASS, col5_6 INT4 NOT NULL, col5_7 INET NULL, col5_8 REGPROCEDURE NOT NULL, col5_9 VARCHAR NULL, col5_10 BYTEA[], col5_11 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col5_7 AS TEXT))) STORED, col5_12 TEXT NULL GENERATED ALWAYS AS (lower(col5_9)) STORED, col5_13 TEXT GENERATED ALWAYS AS (lower(CAST(col5_0 AS TEXT))) STORED, col5_14 INT4 NOT NULL GENERATED ALWAYS AS (col5_6 + col5_4) STORED, col5_15 INT8 NOT NULL GENERATED ALWAYS AS (col5_4 + col5_6) STORED, col5_16 TEXT GENERATED ALWAYS AS (lower(CAST(col5_2 AS TEXT))) STORED, col5_17 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col5_8 IS NULL THEN e'\x00'::TEXT ELSE ''::TEXT END) STORED);
        postgres_1    | 	CREATE UNIQUE INDEX ON table5 (col5_9 DESC, col5_15 DESC);
        postgres_1    | 	CREATE UNIQUE INDEX ON table5 (col5_16 DESC, col5_7 DESC, col5_14 DESC) INCLUDE (col5_2, col5_3, col5_8, col5_10, col5_15, col5_17);
        postgres_1    | 	CREATE UNIQUE INDEX ON table5 (col5_2, col5_12 ASC) INCLUDE (col5_3, col5_4, col5_8, col5_11);
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('wtbu', 'brpj', 'nom', 'zleml', 'izjw');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (608.09s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (4.22s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 REGTYPE NULL, col1_1 BYTEA, col1_2 REGTYPE NULL, col1_3 VARCHAR NOT NULL, col1_4 FLOAT4 NULL, col1_5 INT8[] NULL, col1_6 DATE, col1_7 BYTEA NULL, col1_8 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col1_0 IS NULL THEN ''::TEXT ELSE NULL END) STORED, col1_9 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col1_7 IS NULL THEN e'|&\x0frZB'::TEXT ELSE 'MeTNwD``'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table1 ((CASE WHEN col1_1 IS NULL THEN e'hgQY\x070*\x0e\x03'::TEXT ELSE e'\x0f\''::TEXT END) DESC, col1_3 ASC, col1_7 ASC, col1_2 DESC, col1_1, col1_4 ASC, col1_8 ASC, col1_6, col1_9);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_6, col1_1 ASC, col1_3 DESC, col1_4 DESC, col1_8 ASC, col1_2 DESC, col1_0 ASC, col1_9 ASC, col1_7 DESC) INCLUDE (col1_5);
        test_1        |             CREATE TABLE table2 (col2_0 REGPROC NULL, col2_1 DATE NOT NULL, col2_2 "char", col2_3 "char" NULL, col2_4 BOOL NOT NULL, col2_5 INTERVAL NULL, col2_6 JSONB, col2_7 BYTEA NOT NULL, col2_8 TIMETZ NULL, col2_9 TEXT NOT NULL, PRIMARY KEY (col2_1, col2_7));
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_2, col2_7, col2_9, col2_8 DESC) INCLUDE (col2_0, col2_5, col2_6);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_7 ASC, col2_1 DESC, col2_3, col2_4 ASC, col2_9, col2_5, (true));
        test_1        |             CREATE TABLE table3 (col3_0 FLOAT4 NOT NULL, col3_1 INET NULL, col3_2 GEOMETRY, col3_3 DECIMAL NULL, col3_4 BOOL NULL, col3_5 TIME NULL, col3_6 JSONB NULL, col3_7 DECIMAL NULL, col3_8 DECIMAL NULL GENERATED ALWAYS AS (col3_7 + col3_3) STORED, col3_9 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col3_1 AS TEXT))) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_5 ASC, col3_0 ASC) INCLUDE (col3_2, col3_3, col3_4, col3_7);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_3 DESC, col3_8 ASC, col3_1 ASC) INCLUDE (col3_2, col3_4, col3_5, col3_6);
        test_1        |             CREATE INDEX ON table3 (col3_4 ASC, col3_0 ASC);
        test_1        |             CREATE TABLE table4 (col4_0 INT8 NOT NULL, PRIMARY KEY (col4_0));
        test_1        |             CREATE TABLE table5 (col5_0 INET, col5_1 REGNAMESPACE, col5_2 TIME, col5_3 DATE NOT NULL, col5_4 INT8 NOT NULL, col5_5 REGCLASS, col5_6 INT4 NOT NULL, col5_7 INET NULL, col5_8 REGPROCEDURE NOT NULL, col5_9 VARCHAR NULL, col5_10 BYTEA[], col5_11 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col5_7 AS TEXT))) STORED, col5_12 TEXT NULL GENERATED ALWAYS AS (lower(col5_9)) STORED, col5_13 TEXT GENERATED ALWAYS AS (lower(CAST(col5_0 AS TEXT))) STORED, col5_14 INT4 NOT NULL GENERATED ALWAYS AS (col5_6 + col5_4) STORED, col5_15 INT8 NOT NULL GENERATED ALWAYS AS (col5_4 + col5_6) STORED, col5_16 TEXT GENERATED ALWAYS AS (lower(CAST(col5_2 AS TEXT))) STORED, col5_17 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col5_8 IS NULL THEN e'\x00'::TEXT ELSE ''::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_9 DESC, col5_15 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_16 DESC, col5_7 DESC, col5_14 DESC) INCLUDE (col5_2, col5_3, col5_8, col5_10, col5_15, col5_17);
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_2, col5_12 ASC) INCLUDE (col5_3, col5_4, col5_8, col5_11);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('wtbu', 'brpj', 'nom', 'zleml', 'izjw');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 6a8cfc30d1afea8b34a0c902aa5f5f625d2d21cc:

        postgres_1    | 	CREATE TABLE table5 (col5_0 DECIMAL NOT NULL, col5_1 BOOL[], col5_2 REGCLASS, col5_3 REGTYPE, col5_4 GEOMETRY NOT NULL, col5_5 CHAR NULL, col5_6 TEXT, col5_7 REGTYPE NULL, col5_8 FLOAT8 NOT NULL, col5_9 TEXT GENERATED ALWAYS AS (CASE WHEN col5_3 IS NULL THEN e'|\x12\fq\f\x04'::TEXT ELSE e')\x06zG'::TEXT END) STORED, col5_10 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col5_4 AS TEXT))) STORED, col5_11 TEXT GENERATED ALWAYS AS (CASE WHEN col5_3 IS NULL THEN e'\x13%'::TEXT ELSE ';{bFS|P'::TEXT END) STORED, col5_12 TEXT GENERATED ALWAYS AS (CASE WHEN col5_2 IS NULL THEN e'D:c\x1bx``='::TEXT ELSE e'\x1a'::TEXT END) STORED, col5_13 TEXT GENERATED ALWAYS AS (CASE WHEN col5_3 IS NULL THEN e'1\x7f'::TEXT ELSE e'\x00'::TEXT END) STORED, col5_14 FLOAT8 NOT NULL GENERATED ALWAYS AS (col5_8 + 0.1415099511130395::FLOAT8) STORED);
        postgres_1    | 	CREATE INDEX ON table5 (col5_6, col5_11, col5_14, col5_10 ASC, col5_2 DESC, (col5_0 + 6358537971813.607461::DECIMAL) ASC, col5_9, col5_13 ASC, col5_7, col5_5 DESC);
        postgres_1    | 	CREATE UNIQUE INDEX ON table5 (col5_0 ASC, col5_12 ASC, col5_11) INCLUDE (col5_2, col5_3, col5_4, col5_6, col5_7, col5_8);
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('hih', 'tnyg', 'sbvsjn', 'c', 'wquxn');
        postgres_1    | 	CREATE TYPE rand_typ_1 AS ENUM ('vmvvtf');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (609.10s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (5.18s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 TEXT NOT NULL, col1_1 TIME NOT NULL, PRIMARY KEY (col1_1, col1_0), col1_2 TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_0)) STORED);
        test_1        |             CREATE INDEX ON table1 (lower(CAST(col1_1 AS TEXT)) DESC);
        test_1        |             CREATE INDEX ON table1 (col1_2 ASC, col1_1);
        test_1        |             CREATE INDEX ON table1 (col1_2 ASC, col1_0);
        test_1        |             CREATE TABLE table2 (col2_0 TIME NOT NULL, col2_1 TIMETZ, col2_2 CHAR NULL, col2_3 FLOAT8, col2_4 UUID NOT NULL, col2_5 TIME NOT NULL, col2_6 VARCHAR NOT NULL, col2_7 INT4, col2_8 GEOGRAPHY NULL, col2_9 FLOAT4 NOT NULL, col2_10 DATE NOT NULL, col2_11 TIMESTAMP NOT NULL, col2_12 INET NULL, PRIMARY KEY (col2_11));
        test_1        |             CREATE INDEX ON table2 (col2_0);
        test_1        |             CREATE TABLE table3 (col3_0 INT4 NOT NULL, col3_1 UUID NOT NULL, col3_2 TIME NOT NULL, col3_3 DECIMAL, col3_4 GEOGRAPHY NULL, col3_5 GEOGRAPHY NULL, col3_6 DATE NULL, col3_7 DATE NULL, col3_8 TIME NOT NULL, col3_9 REGPROCEDURE NULL, col3_10 GEOGRAPHY NULL, col3_11 INT8, col3_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col3_8 AS TEXT))) STORED, col3_13 INT4 NOT NULL GENERATED ALWAYS AS (col3_0 + 127::INT8) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_1);
        test_1        |             CREATE INDEX ON table3 ((col3_11 + (-2505444925430374224)::INT8) DESC, col3_9 DESC, col3_2, col3_7 ASC, col3_11, col3_3 ASC, (col3_11 + col3_0) ASC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_2 ASC, col3_3, col3_9 DESC, col3_6 ASC, col3_13) INCLUDE (col3_0, col3_5, col3_7, col3_8, col3_10, col3_11);
        test_1        |             CREATE TABLE table4 (col4_0 INT2, col4_1 BIT(5), col4_2 REGNAMESPACE NOT NULL, col4_3 CHAR NOT NULL, col4_4 REGNAMESPACE NOT NULL, col4_5 REGNAMESPACE, col4_6 REGROLE NOT NULL, col4_7 INT8 NOT NULL, col4_8 INTERVAL NOT NULL, PRIMARY KEY (col4_6, col4_2, col4_4, col4_3, col4_8), col4_9 INT2 GENERATED ALWAYS AS (col4_0 + 13621::INT8) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_4, col4_3 DESC, col4_0 ASC, col4_7 DESC, col4_2, col4_5 DESC, col4_1 DESC, col4_6, col4_9 ASC, col4_8 DESC);
        test_1        |             CREATE INDEX ON table4 (col4_0, col4_8, col4_9 ASC, col4_6 ASC, col4_2, (CASE WHEN col4_2 IS NULL THEN e'QHo\x1d>CP'::TEXT ELSE ')]S(RFKC'::TEXT END), col4_7 ASC);
        test_1        |             CREATE INDEX ON table4 (col4_7 ASC, col4_8 DESC, col4_0 ASC, (col4_0 + col4_7) ASC, col4_6 ASC, col4_1 DESC, col4_2 DESC, col4_3 ASC, col4_5, col4_9 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_2, col4_7 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_8 ASC, col4_2, col4_6, col4_3 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_5 DESC, col4_4 ASC, col4_9 ASC, (CASE WHEN col4_2 IS NULL THEN e'!=\x11rH}P'::TEXT ELSE e'\\K'::TEXT END) DESC, col4_0 DESC, col4_1 ASC, col4_2, col4_3 ASC);
        test_1        |             CREATE INDEX ON table4 (col4_6, col4_7 DESC, col4_8, (col4_0 + col4_7) ASC, col4_9 ASC, col4_2 DESC, col4_0, col4_3);
        test_1        |             CREATE TABLE table5 (col5_0 DECIMAL NOT NULL, col5_1 BOOL[], col5_2 REGCLASS, col5_3 REGTYPE, col5_4 GEOMETRY NOT NULL, col5_5 CHAR NULL, col5_6 TEXT, col5_7 REGTYPE NULL, col5_8 FLOAT8 NOT NULL, col5_9 TEXT GENERATED ALWAYS AS (CASE WHEN col5_3 IS NULL THEN e'|\x12\fq\f\x04'::TEXT ELSE e')\x06zG'::TEXT END) STORED, col5_10 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col5_4 AS TEXT))) STORED, col5_11 TEXT GENERATED ALWAYS AS (CASE WHEN col5_3 IS NULL THEN e'\x13%'::TEXT ELSE ';{bFS|P'::TEXT END) STORED, col5_12 TEXT GENERATED ALWAYS AS (CASE WHEN col5_2 IS NULL THEN e'D:c\x1bx``='::TEXT ELSE e'\x1a'::TEXT END) STORED, col5_13 TEXT GENERATED ALWAYS AS (CASE WHEN col5_3 IS NULL THEN e'1\x7f'::TEXT ELSE e'\x00'::TEXT END) STORED, col5_14 FLOAT8 NOT NULL GENERATED ALWAYS AS (col5_8 + 0.1415099511130395::FLOAT8) STORED);
        test_1        |             CREATE INDEX ON table5 (col5_6, col5_11, col5_14, col5_10 ASC, col5_2 DESC, (col5_0 + 6358537971813.607461::DECIMAL) ASC, col5_9, col5_13 ASC, col5_7, col5_5 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_0 ASC, col5_12 ASC, col5_11) INCLUDE (col5_2, col5_3, col5_4, col5_6, col5_7, col5_8);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('hih', 'tnyg', 'sbvsjn', 'c', 'wquxn');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('vmvvtf');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 5470127e589a9f0059f894ef60b21a7ac8819f0c:

        postgres_1    | 		col_409598 NULLS FIRST, col_409599 NULLS FIRST, col_409600 NULLS FIRST
        postgres_1    | 2022-10-14 05:22:08.865 UTC [76] ERROR:  could not identify an ordering operator for type box2d[] at character 114
        postgres_1    | 2022-10-14 05:22:08.865 UTC [76] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2022-10-14 05:22:08.865 UTC [76] STATEMENT:  SELECT
        postgres_1    | 		*
        postgres_1    | 	FROM
        postgres_1    | 		(SELECT NULL::BOX2D[] AS col_409800, 'true'::JSONB::JSONB AS col_409801) AS tab_230932
        postgres_1    | 	ORDER BY
        postgres_1    | 		col_409800 NULLS FIRST, col_409801 NULLS FIRST
        test_1        | --- FAIL: TestCompare (946.52s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (341.85s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	nil,
        test_1        |             + 	string("BOX(-45 0,0 45)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('E':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_410055) AS tab_231086
        test_1        |             ORDER BY
        test_1        |             	CAST(col_410055 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('E'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_410055) AS tab_231086
        test_1        |             ORDER BY
        test_1        |             	CAST(col_410055 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 06fb4817f5ce494565674a1b4784d92ac6624fac:

        postgres_1    | CREATE EXTENSION
        postgres_1    | Loading PostGIS extensions into postgres
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | 2022-10-18 05:17:10.131 UTC [49] LOG:  received fast shutdown request
        postgres_1    | waiting for server to shut down....2022-10-18 05:17:10.133 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2022-10-18 05:17:10.135 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2022-10-18 05:17:10.136 UTC [51] LOG:  shutting down
        postgres_1    | 2022-10-18 05:17:10.255 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2022-10-18 05:17:10.355 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2022-10-18 05:17:10.355 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2022-10-18 05:17:10.355 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2022-10-18 05:17:10.360 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2022-10-18 05:17:10.366 UTC [68] LOG:  database system was shut down at 2022-10-18 05:17:10 UTC
        postgres_1    | 2022-10-18 05:17:10.371 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2022-10-18 05:27:12.372 UTC [98] ERROR:  syntax error at or near "DESC" at character 325
        postgres_1    | 2022-10-18 05:27:12.372 UTC [98] STATEMENT:  CREATE TABLE table1 (col1_0 REGCLASS NULL, col1_1 FLOAT4 NULL, col1_2 INT8 NULL, col1_3 TIME[] NULL, col1_4 INT2, col1_5 INET NOT NULL, col1_6 TIMESTAMP, col1_7 CHAR NULL, col1_8 GEOMETRY NULL, col1_9 FLOAT4 NULL GENERATED ALWAYS AS (col1_1 + (-0.6751755475997925)::FLOAT8) STORED, INVERTED INDEX (col1_0, (col1_2 + col1_4) DESC, col1_2 ASC, col1_9 DESC, col1_4, col1_8) WHERE (table1.col1_6 > '0001-01-01 00:00:00'::TIMESTAMP) OR (table1.col1_9 >= 3.4028234663852886e+38::FLOAT8));
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('yko');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (605.12s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.32s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 REGCLASS NULL, col1_1 FLOAT4 NULL, col1_2 INT8 NULL, col1_3 TIME[] NULL, col1_4 INT2, col1_5 INET NOT NULL, col1_6 TIMESTAMP, col1_7 CHAR NULL, col1_8 GEOMETRY NULL, col1_9 FLOAT4 NULL GENERATED ALWAYS AS (col1_1 + (-0.6751755475997925)::FLOAT8) STORED, INVERTED INDEX (col1_0, (col1_2 + col1_4) DESC, col1_2 ASC, col1_9 DESC, col1_4, col1_8) WHERE (table1.col1_6 > '0001-01-01 00:00:00'::TIMESTAMP) OR (table1.col1_9 >= 3.4028234663852886e+38::FLOAT8));
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('yko');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: syntax error at or near "DESC" (SQLSTATE 42601)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ a2541a00d02f897bfb2ceab0d772b235981198c3:

        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (288.61s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	nil,
        test_1        |             + 	string("BOX(-180 45,-135 90)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			COALESCE(st_box2dfromgeohash('B':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D, NULL::BOX2D)
        test_1        |             				AS col_371530
        test_1        |             	)
        test_1        |             		AS tab_195960
        test_1        |             ORDER BY
        test_1        |             	CAST(col_371530 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			COALESCE(st_box2dfromgeohash('B'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D, NULL::BOX2D)
        test_1        |             				AS col_371530
        test_1        |             	)
        test_1        |             		AS tab_195960
        test_1        |             ORDER BY
        test_1        |             	CAST(col_371530 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 5523ed8ac9784dd20d1ee88db2faaff903c7aa94:

        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |               	string("H"),
        test_1        |             - 	nil,
        test_1        |             + 	string("BOX(-90 0,-45 45)"),
        test_1        |               	float64(4),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			'H':::STRING::NAME AS col_10610,
        test_1        |             			st_box2dfromgeohash('D':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_10611,
        test_1        |             			4.0:::FLOAT8::FLOAT8 AS col_10612
        test_1        |             	)
        test_1        |             		AS tab_7121
        test_1        |             ORDER BY
        test_1        |             	col_10610 NULLS FIRST, CAST(col_10611 AS STRING) NULLS FIRST, col_10612 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			'H'::TEXT::NAME AS col_10610,
        test_1        |             			st_box2dfromgeohash('D'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_10611,
        test_1        |             			4.0::FLOAT8::FLOAT8 AS col_10612
        test_1        |             	)
        test_1        |             		AS tab_7121
        test_1        |             ORDER BY
        test_1        |             	col_10610 NULLS FIRST, CAST(col_10611 AS TEXT) NULLS FIRST, col_10612 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ d7e83c2734d4986269c49bb6a401dee983bd4e3d:

        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	string("{NULL,NULL}"),
        test_1        |             + 	string("{NULL:NULL}"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			tab_346179.col_485553 AS col_485554
        test_1        |             		FROM
        test_1        |             			(
        test_1        |             				VALUES
        test_1        |             					(
        test_1        |             						(st_makepolygon(NULL::GEOMETRY::GEOMETRY)::GEOMETRY::GEOMETRY || CASE WHEN NULL::BOOL THEN NULL::GEOMETRY[] ELSE (NULL::GEOMETRY::GEOMETRY || NULL::GEOMETRY[]::GEOMETRY[])::GEOMETRY[] END::GEOMETRY[])::GEOMETRY[]
        test_1        |             					),
        test_1        |             					(NULL::GEOMETRY[]),
        test_1        |             					(NULL::GEOMETRY[]),
        test_1        |             					(NULL::GEOMETRY[]),
        test_1        |             					(NULL::GEOMETRY[])
        test_1        |             			)
        test_1        |             				AS tab_346179 (col_485553)
        test_1        |             		WHERE
        test_1        |             			true::BOOL
        test_1        |             		ORDER BY
        test_1        |             			tab_346179.col_485553 ASC, tab_346179.col_485553 DESC, tab_346179.col_485553
        test_1        |             	)
        test_1        |             		AS tab_346180
        test_1        |             ORDER BY
        test_1        |             	col_485554 NULLS FIRST;
        test_1        |             
        test_1        |             postgres: [same as previous]
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ b03609dfb72f36073cd380327d9f716635535a83:

        test_1        |             + 				Exp:    -16,
        test_1        |               				Status: 2,
        test_1        |               				NaN:    false,
        test_1        |               			},
        test_1        |               		},
        test_1        |               		Dimensions: {{Length: 1, LowerBound: 1}},
        test_1        |               		Status:     2,
        test_1        |               	},
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			'\x45':::BYTES::BYTES AS col_134858,
        test_1        |             			NULL::OIDVECTOR AS col_134859,
        test_1        |             			((NULL::DECIMAL[]::DECIMAL[] || log(7:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL[]::DECIMAL[] || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |             				AS col_134860
        test_1        |             	)
        test_1        |             		AS tab_126335
        test_1        |             ORDER BY
        test_1        |             	col_134858 NULLS FIRST, col_134859 NULLS FIRST, col_134860 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			'\x45'::BYTEA::BYTEA AS col_134858,
        test_1        |             			NULL::OIDVECTOR AS col_134859,
        test_1        |             			((NULL::DECIMAL[]::DECIMAL[] || log(7::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL[]::DECIMAL[] || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |             				AS col_134860
        test_1        |             	)
        test_1        |             		AS tab_126335
        test_1        |             ORDER BY
        test_1        |             	col_134858 NULLS FIRST, col_134859 NULLS FIRST, col_134860 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 7875ba6ce643b52e272d8638e4d67fc018f8168a:

        postgres_1    | 				NULL::BOOL
        postgres_1    | 			GROUP BY
        postgres_1    | 				tab_199593.col1_0, tab_199593.tableoid, tab_199593.col1_5
        postgres_1    | 			ORDER BY
        postgres_1    | 				tab_199593.col1_0, tab_199593.col1_5 DESC, tab_199593.col1_0 DESC
        postgres_1    | 		)
        postgres_1    | 			AS tab_199594
        postgres_1    | 	ORDER BY
        postgres_1    | 		col_362832 NULLS FIRST
        test_1        | --- FAIL: TestCompare (899.14s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (294.46s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	nil,
        test_1        |             + 	string("0103000000010000000500000000000000008056C0000000000080464000000000008056C0000000000080564000000000008046C0000000000080564000000000008046C0000000000080464000000000008056C00000000000804640"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_geomfromgeohash('F':::STRING::STRING::STRING, NULL::INT4::INT4)::GEOMETRY AS col_362960) AS tab_199687
        test_1        |             ORDER BY
        test_1        |             	col_362960 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_geomfromgeohash('F'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::GEOMETRY AS col_362960) AS tab_199687
        test_1        |             ORDER BY
        test_1        |             	col_362960 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Dec 2, 2022
Closed
@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 53f7d77e07b376edc01fb47186851d7ee4899c46:

        postgres_1    | 				postgres.public.table3 AS tab_180327
        postgres_1    | 			WHERE
        postgres_1    | 				false::BOOL
        postgres_1    | 			ORDER BY
        postgres_1    | 				tab_180327.col3_10 DESC
        postgres_1    | 		)
        postgres_1    | 			AS tab_180328
        postgres_1    | 	ORDER BY
        postgres_1    | 		col_317219 NULLS FIRST, col_317220 NULLS FIRST, col_317221 NULLS FIRST, col_317222 NULLS FIRST
        test_1        | --- FAIL: TestCompare (890.43s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (285.23s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             - 	nil,
        test_1        |             + 	string("BOX(-135 45,-90 90)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('C':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_317260) AS tab_180357
        test_1        |             ORDER BY
        test_1        |             	CAST(col_317260 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(SELECT st_box2dfromgeohash('C'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_317260) AS tab_180357
        test_1        |             ORDER BY
        test_1        |             	CAST(col_317260 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ 9c5bcfb9e024165f91494929a15477c5126611ff:

        postgres_1    | CREATE EXTENSION
        postgres_1    | Loading PostGIS extensions into postgres
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down...2022-12-06 06:12:49.569 UTC [49] LOG:  received fast shutdown request
        postgres_1    | .2022-12-06 06:12:49.571 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2022-12-06 06:12:49.572 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2022-12-06 06:12:49.574 UTC [51] LOG:  shutting down
        postgres_1    | 2022-12-06 06:12:49.665 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2022-12-06 06:12:49.686 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2022-12-06 06:12:49.686 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2022-12-06 06:12:49.686 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2022-12-06 06:12:49.689 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2022-12-06 06:12:49.693 UTC [68] LOG:  database system was shut down at 2022-12-06 06:12:49 UTC
        postgres_1    | 2022-12-06 06:12:49.697 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2022-12-06 06:12:51.087 UTC [78] ERROR:  syntax error at or near "ASC" at character 525
        postgres_1    | 2022-12-06 06:12:51.087 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 "char", col1_1 BOX2D[] NULL, col1_2 INTERVAL NOT NULL, col1_3 REGNAMESPACE, col1_4 REGTYPE, col1_5 TIMETZ NOT NULL, col1_6 TIMETZ, col1_7 TIMESTAMP NOT NULL, col1_8 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col1_1 IS NULL THEN e'm#uk|L7\\'::TEXT ELSE e'\fbMH_l\x18U'::TEXT END) STORED, col1_9 TEXT GENERATED ALWAYS AS (lower(CAST(col1_6 AS TEXT))) STORED, col1_10 TEXT GENERATED ALWAYS AS (CASE WHEN col1_4 IS NULL THEN e'fz.%\x1d'::TEXT ELSE e'\x04\x0e'::TEXT END) STORED, INVERTED INDEX (col1_9 ASC, col1_3, col1_1 ASC), INVERTED INDEX (col1_8 ASC, col1_2 ASC, col1_5, col1_4, col1_3 DESC, col1_1 DESC) WHERE (((((table1.col1_6 != '00:00:00+15:59:00'::TIMETZ) AND (table1.col1_7 < '294276-12-31 23:59:59.999999'::TIMESTAMP)) AND (table1.col1_10 = e'\x00'::TEXT)) AND (table1.col1_8 > ''::TEXT)) OR (table1.col1_5 < '24:00:00-15:59:00'::TIMETZ)) AND (table1.col1_9 > e'\U00002603'::TEXT));
        postgres_1    | 	CREATE TYPE rand_typ_0 AS ENUM ('nhqmm', 'qazdd', 'we', 'sh', 'bifd', 'wlio');
        postgres_1    | 	
        test_1        | --- FAIL: TestCompare (604.57s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.68s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 "char", col1_1 BOX2D[] NULL, col1_2 INTERVAL NOT NULL, col1_3 REGNAMESPACE, col1_4 REGTYPE, col1_5 TIMETZ NOT NULL, col1_6 TIMETZ, col1_7 TIMESTAMP NOT NULL, col1_8 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col1_1 IS NULL THEN e'm#uk|L7\\'::TEXT ELSE e'\fbMH_l\x18U'::TEXT END) STORED, col1_9 TEXT GENERATED ALWAYS AS (lower(CAST(col1_6 AS TEXT))) STORED, col1_10 TEXT GENERATED ALWAYS AS (CASE WHEN col1_4 IS NULL THEN e'fz.%\x1d'::TEXT ELSE e'\x04\x0e'::TEXT END) STORED, INVERTED INDEX (col1_9 ASC, col1_3, col1_1 ASC), INVERTED INDEX (col1_8 ASC, col1_2 ASC, col1_5, col1_4, col1_3 DESC, col1_1 DESC) WHERE (((((table1.col1_6 != '00:00:00+15:59:00'::TIMETZ) AND (table1.col1_7 < '294276-12-31 23:59:59.999999'::TIMESTAMP)) AND (table1.col1_10 = e'\x00'::TEXT)) AND (table1.col1_8 > ''::TEXT)) OR (table1.col1_5 < '24:00:00-15:59:00'::TIMETZ)) AND (table1.col1_9 > e'\U00002603'::TEXT));
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('nhqmm', 'qazdd', 'we', 'sh', 'bifd', 'wlio');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: syntax error at or near "ASC" (SQLSTATE 42601)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ c8a34a5bfd9e809d7df80555185d0c6b41ecc0b1:

        test_1        |             CREATE INDEX ON table1 (col1_4 ASC);
        test_1        |             CREATE TABLE table2 (col2_0 TIMETZ, col2_1 STRING NOT NULL, col2_2 INT8 NOT NULL, col2_3 VARCHAR NOT NULL, col2_4 INT4 NOT NULL, col2_5 VARCHAR NOT NULL, col2_6 INT4, col2_7 INET NOT NULL, PRIMARY KEY (col2_3, col2_5, col2_4, col2_1, col2_7, col2_2), col2_8 INT4 AS ((col2_4 + col2_2) + col2_6) VIRTUAL, col2_9 INT4 AS ((col2_4 + col2_2) + col2_6) STORED);
        test_1        |             CREATE INDEX ON table2 (col2_9 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0, col2_7 ASC, col2_1) STORING (col2_9);
        test_1        |             CREATE UNIQUE INDEX ON table2 (lower(col2_5), col2_7 ASC, col2_1 ASC);
        test_1        |             CREATE INDEX ON table2 (col2_5 DESC, col2_2 DESC, col2_4, col2_9);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_4 DESC, col2_2 ASC, col2_6 DESC, col2_5 ASC, col2_3 DESC) STORING (col2_9);
        test_1        |             CREATE INDEX ON table2 (col2_4 DESC, (col2_2 + col2_4) DESC, col2_8 DESC, col2_9);
        test_1        |             CREATE UNIQUE INDEX ON table2 ((col2_4 + col2_2));
        test_1        |             CREATE INDEX ON table2 (col2_1 ASC, col2_2 DESC, col2_5 ASC, col2_0, col2_7 DESC, col2_3 ASC, col2_4 ASC, col2_9, col2_8 DESC, col2_6);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_7);
        test_1        |             CREATE TABLE table3 (col3_0 "char", col3_1 INET NOT NULL, col3_2 STRING NOT NULL AS (lower(CAST(col3_1 AS STRING))) STORED);
        test_1        |             CREATE INDEX ON table3 (col3_0, col3_1 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_1 DESC, col3_0 DESC);
        test_1        |             CREATE INDEX ON table3 (col3_1);
        test_1        |             CREATE INDEX ON table3 (col3_0, col3_2);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_1 DESC, col3_0 ASC);
        test_1        |             CREATE INDEX ON table3 (col3_0 DESC);
        test_1        |             CREATE INDEX ON table3 (col3_1 DESC, col3_0 DESC);
        test_1        |             CREATE INDEX ON table3 (col3_2, col3_1 DESC);
        test_1        |             CREATE TABLE table4 (col4_0 TIMESTAMPTZ NOT NULL, col4_1 DATE NOT NULL, col4_2 DECIMAL NOT NULL, PRIMARY KEY (col4_1, col4_0, col4_2), col4_3 DECIMAL NOT NULL AS (col4_2 + (-58256132874.81467213):::DECIMAL) STORED, col4_4 DECIMAL NOT NULL AS (col4_2 + 3.54731332810501801E+34:::DECIMAL) VIRTUAL, FAMILY (col4_3), FAMILY (col4_1, col4_2, col4_0));
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_0 ASC, col4_1, col4_2 ASC) STORING (col4_3);
        test_1        |             CREATE INDEX ON table4 (col4_0, col4_2);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_2 ASC, col4_3 ASC, col4_0);
        test_1        |             CREATE INDEX ON table4 (col4_2 DESC);
        test_1        |             CREATE TABLE table5 (col5_0 STRING NOT NULL, col5_1 INT2 NOT NULL, col5_2 BOX2D NOT NULL, col5_3 BOOL NOT NULL, PRIMARY KEY (col5_3, col5_0), FAMILY (col5_0), FAMILY (col5_2), FAMILY (col5_3), FAMILY (col5_1));
        test_1        |             CREATE INDEX ON table5 (col5_0, col5_3);
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_0) STORING (col5_1);
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4570925785842893613, "histo_col_type": "", "name": "__auto__", "null_count": 1346715948978097878, "row_count": 4710454971351070897}, {"columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3265692543674416315, "histo_col_type": "", "name": "__auto__", "null_count": 4447542196176180168, "row_count": 4710454971351070897}, {"columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1739921487497375507, "histo_col_type": "", "name": "__auto__", "null_count": 2582305531115879096, "row_count": 4710454971351070897}, {"columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2885675676633876713, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4710454971351070897}, {"columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4190008306735995620, "histo_col_type": "", "name": "__auto__", "null_count": 1060950471356695050, "row_count": 4710454971351070897}, {"columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 735109185113248678, "histo_col_type": "", "name": "__auto__", "null_count": 4120624682822920747, "row_count": 4710454971351070897}, {"columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3008049387128238511, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4710454971351070897}, {"columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2286395661519567040, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "-79 years -38 days -02:54:21.940621"}, {"distinct_range": 60000, "num_eq": 700000, "num_range": 60000, "upper_bound": "-15 years -11 mons -36 days -07:28:54.390756"}, {"distinct_range": 8650984787964321000, "num_eq": 8000000, "num_range": 8650984787964320444, "upper_bound": "-13 years -10 mons -474 days -05:29:56.984571"}, {"distinct_range": 0, "num_eq": 2000000, "num_range": 8243438156278118457, "upper_bound": "-6 years -11 mons -972 days -15:13:48.601356"}, {"distinct_range": 0, "num_eq": 40000000000, "num_range": 3671536503649445258, "upper_bound": "10 years 5 mons 563 days 04:14:25.918019"}, {"distinct_range": 0, "num_eq": 300, "num_range": 1000000, "upper_bound": "41 years 11 mons 39 days 03:02:00.531598"}, {"distinct_range": 1306623906364432400, "num_eq": 1000, "num_range": 1306623906364432325, "upper_bound": "82 years 10 mons 531 days 16:07:49.275393"}], "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 1425998694647349376, "row_count": 4710454971351070897}, {"columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4531397677558181853, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000, "num_range": 0, "upper_bound": "BOX(-0.8568888637893373 0.9405707105412775,1.793066465018334 1.1834548298954906)"}, {"distinct_range": 0, "num_eq": 50000, "num_range": 4934097848405685369, "upper_bound": "BOX(0.015035590727488751 -1.18006249066535,0.6231743549858915 -0.8961975384683809)"}, {"distinct_range": 500000000, "num_eq": 400000, "num_range": 500000000, "upper_bound": "BOX(0.4507556596070179 0.4300549500433348,0.6519460971148907 1.427535537784005)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 0, "row_count": 4710454971351070897}]':::JSONB;
        test_1        |             ALTER TABLE table2 INJECT STATISTICS '[{"columns": ["col2_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 58, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"columns": ["col2_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31, "histo_buckets": [{"distinct_range": 0, "num_eq": 5239618526463625013, "num_range": 0, "upper_bound": ""}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 100}, {"columns": ["col2_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 35, "histo_col_type": "", "name": "__auto__", "null_count": 86, "row_count": 100}, {"columns": ["col2_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 99, "histo_col_type": "", "name": "__auto__", "null_count": 56, "row_count": 100}, {"columns": ["col2_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 66, "histo_buckets": [{"distinct_range": 0, "num_eq": 2228589287939130571, "num_range": 0, "upper_bound": "05:31:52.987158-12:27:00"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 9, "row_count": 100}, {"columns": ["col2_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 38, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"columns": ["col2_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 60, "histo_buckets": [{"distinct_range": 0, "num_eq": 700000000, "num_range": 0, "upper_bound": "-642270751"}, {"distinct_range": 600000, "num_eq": 2000, "num_range": 600000, "upper_bound": "-30670322"}, {"distinct_range": 0, "num_eq": 7000000, "num_range": 5457991246554863360, "upper_bound": "1322152512"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 100}, {"columns": ["col2_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"columns": ["col2_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"columns": ["col2_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 56, "histo_col_type": "", "name": "__auto__", "null_count": 89, "row_count": 100}]':::JSONB;
        test_1        |             ALTER TABLE table3 INJECT STATISTICS e'[{"columns": ["col3_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 463277, "histo_col_type": "\\"char\\"", "name": "__auto__", "null_count": 149989, "row_count": 1000000}, {"columns": ["col3_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 933686, "histo_buckets": [{"distinct_range": 0, "num_eq": 6129480142251352560, "num_range": 0, "upper_bound": "0.0.0.0/0"}, {"distinct_range": 37977.91369163723, "num_eq": 800000, "num_range": 50000, "upper_bound": "250.182.239.48/9"}, {"distinct_range": 0, "num_eq": 531104161168678021, "num_range": 2285282273250564182, "upper_bound": "68.102.51.180/15"}, {"distinct_range": 0, "num_eq": 1403914691404518193, "num_range": 7222604488214557235, "upper_bound": "20.22.54.244/25"}, {"distinct_range": 3850244.889845831, "num_eq": 20000000, "num_range": 8000000, "upper_bound": "202.180.147.18/28"}, {"distinct_range": 40000, "num_eq": 70000, "num_range": 40000, "upper_bound": "d831:f7c3:ce8f:1712:d448:d1e2:47bc:3f60/17"}, {"distinct_range": 94.94802142367573, "num_eq": 400, "num_range": 400, "upper_bound": "381b:8ef:ec1a:7ab:d2b3:8e40:3b4c:f074/61"}, {"distinct_range": 0, "num_eq": 5456513739383241380, "num_range": 4442186817886588048, "upper_bound": "aa35:885c:a994:b91d:293b:5cdf:b0a5:aed/119"}], "histo_col_type": "INET", "name": "__auto__", "null_count": 0, "row_count": 1000000}, {"columns": ["col3_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 374129, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "]wC\\u0014\\t"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 1000000}]':::JSONB;
        test_1        |             ALTER TABLE table4 INJECT STATISTICS '[{"columns": ["col4_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3173138, "histo_buckets": [{"distinct_range": 0, "num_eq": 3992717794149072009, "num_range": 0, "upper_bound": "1981-04-14 18:15:04.000111+00:00"}, {"distinct_range": 12698.522640386384, "num_eq": 9110080142979241979, "num_range": 60000, "upper_bound": "1997-03-27 01:13:53.000385+00:00"}, {"distinct_range": 23.887713846067296, "num_eq": 20000, "num_range": 50, "upper_bound": "2013-07-13 15:44:31.000104+00:00"}, {"distinct_range": 3000000, "num_eq": 8000000, "num_range": 3000000, "upper_bound": "2028-11-18 00:27:27.000515+00:00"}], "histo_col_type": "TIMESTAMPTZ", "name": "__auto__", "null_count": 0, "row_count": 6000000}, {"columns": ["col4_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5898908, "histo_buckets": [{"distinct_range": 0, "num_eq": 90000, "num_range": 0, "upper_bound": "1971-01-24"}, {"distinct_range": 4999283192078881000, "num_eq": 1702045635074994940, "num_range": 6096406013396863208, "upper_bound": "1972-06-13"}, {"distinct_range": 1791676.6916813906, "num_eq": 1000000000, "num_range": 2000000, "upper_bound": "1977-04-21"}, {"distinct_range": 78997898.29978494, "num_eq": 70, "num_range": 100000000, "upper_bound": "1996-03-02"}, {"distinct_range": 70448.41872362871, "num_eq": 53629767770779856, "num_range": 80000, "upper_bound": "infinity"}], "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 6000000}, {"columns": ["col4_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4289658, "histo_buckets": [{"distinct_range": 0, "num_eq": 8546989900420031403, "num_range": 0, "upper_bound": "-7.908882418604942182"}, {"distinct_range": 0, "num_eq": 50000000000, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 6000000, "num_eq": 6112727559512393802, "num_range": 6000000, "upper_bound": "52847.5147539441427"}, {"distinct_range": 2615.054672657973, "num_eq": 2237743118461182643, "num_range": 40000, "upper_bound": "65431093668173.38329"}, {"distinct_range": 0, "num_eq": 6398778095406747339, "num_range": 30000, "upper_bound": "616066049712145.7493"}, {"distinct_range": 40000000, "num_eq": 3515389498728249695, "num_range": 40000000, "upper_bound": "3647414734159907122"}, {"distinct_range": 20, "num_eq": 8803266289500928830, "num_range": 20, "upper_bound": "1.197758480694251379E+22"}, {"distinct_range": 3473307201274162700, "num_eq": 231283534730280497, "num_range": 3473307201274162540, "upper_bound": "3.967612153838406279E+30"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 0, "row_count": 6000000}, {"columns": ["col4_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1881150, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000000}, {"columns": ["col4_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 450959, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000000}]':::JSONB;
        test_1        |             ALTER TABLE table5 INJECT STATISTICS e'[{"columns": ["col5_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1210625909, "histo_buckets": [{"distinct_range": 0, "num_eq": 1856104059800110400, "num_range": 0, "upper_bound": "\\u0019\\u0011\\u0007}&\\\\ZXb"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 2000000000}, {"columns": ["col5_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 444647808, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2000000000}, {"columns": ["col5_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1013888749, "histo_buckets": [{"distinct_range": 0, "num_eq": 9000, "num_range": 0, "upper_bound": "BOX(-1.7446129113953792 -1.0597250428906844,0.11513220138886782 0.8871385302671692)"}, {"distinct_range": 0, "num_eq": 10000000, "num_range": 3000000000, "upper_bound": "BOX(-1.5363700027890301 -0.7879187656036428,0.39686235120093927 1.4198602171025352)"}, {"distinct_range": 5908850023455946000, "num_eq": 8000000, "num_range": 6969743185434101655, "upper_bound": "BOX(-1.4741323005720355 0.07252100084397611,0.053657577544697854 0.5215091461605581)"}, {"distinct_range": 0, "num_eq": 8560976132751551387, "num_range": 300000000, "upper_bound": "BOX(-1.2025912366830607 -1.1907781528123964,0.349101104997529 -0.33536065324979436)"}, {"distinct_range": 6780685200161591000, "num_eq": 300, "num_range": 8951310330461739812, "upper_bound": "BOX(-0.4917167940366276 0.24678523799374386,-0.08741098951163973 2.3982800787784937)"}, {"distinct_range": 613966651385578100, "num_eq": 500000, "num_range": 7770687690226045575, "upper_bound": "BOX(-0.2253404143953961 0.3569431221316981,1.879927797002864 2.3709234372174843)"}, {"distinct_range": 8000000000, "num_eq": 2351995138442678252, "num_range": 8000000000, "upper_bound": "BOX(-0.15714662402506185 0.1435900805346643,0.4966706669248495 1.1295704901514063)"}, {"distinct_range": 0, "num_eq": 60000000000, "num_range": 60000000, "upper_bound": "BOX(0.10313893784432526 -0.19735158525949748,0.8249203324614759 0.4936435053029231)"}, {"distinct_range": 0, "num_eq": 3000000, "num_range": 8574128269700147096, "upper_bound": "BOX(0.4886828977901492 -0.06318399963405927,0.853845250318258 0.39172662740170916)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 0, "row_count": 2000000000}, {"columns": ["col5_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1861538464, "histo_buckets": [{"distinct_range": 0, "num_eq": 4814637271288040889, "num_range": 0, "upper_bound": "false"}, {"distinct_range": 2786478894302823000, "num_eq": 900000, "num_range": 8843495665406603697, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 2000000000}]':::JSONB;
        test_1        |             ALTER TABLE table5 ADD FOREIGN KEY (col5_2) REFERENCES table1 (col1_7) ON DELETE RESTRICT;
        test_1        |             ALTER TABLE table3 ADD FOREIGN KEY (col3_1) REFERENCES table2 (col2_7);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('orjgom', 'anyr');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('h', 'g');
        test_1        |             
        test_1        |         compare_test.go:154: cockroach1: exec: ERROR: there is no unique constraint matching given keys for referenced table table1 (SQLSTATE 23503)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Jan 17, 2023
Closed
@cockroach-teamcity
Copy link
Member Author

compose.TestComposeCompare failed with artifacts on release-21.2 @ b42a73fe1989672a2618efd95023e2924c23fc31:

        test_1        |             + 				Int:    s"4771212547196624",
        test_1        |             - 				Exp:    -20,
        test_1        |             + 				Exp:    -16,
        test_1        |               				Status: 2,
        test_1        |               				NaN:    false,
        test_1        |               			},
        test_1        |               		},
        test_1        |               		Dimensions: {{Length: 3, LowerBound: 1}},
        test_1        |               		Status:     2,
        test_1        |               	},
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			3:::OID::OID AS col_318980,
        test_1        |             			((7:::DECIMAL::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]::DECIMAL[] || ((7:::DECIMAL::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]::DECIMAL[] || log(round(log(2:::DECIMAL::DECIMAL::DECIMAL, 9:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |             				AS col_318981
        test_1        |             	)
        test_1        |             		AS tab_187658
        test_1        |             ORDER BY
        test_1        |             	col_318980 NULLS FIRST, col_318981 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |             	*
        test_1        |             FROM
        test_1        |             	(
        test_1        |             		SELECT
        test_1        |             			3::OID::OID AS col_318980,
        test_1        |             			((7::DECIMAL::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]::DECIMAL[] || ((7::DECIMAL::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]::DECIMAL[] || log(round(log(2::DECIMAL::DECIMAL::DECIMAL, 9::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |             				AS col_318981
        test_1        |             	)
        test_1        |             		AS tab_187658
        test_1        |             ORDER BY
        test_1        |             	col_318980 NULLS FIRST, col_318981 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...
        
    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: 

make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Mar 22, 2023
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Apr 12, 2023
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue May 16, 2023
Closed
@tbg tbg added the T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) label Jun 30, 2023
@rafiss
Copy link
Collaborator

rafiss commented Jul 6, 2023

Closing since it's from 21.2

@rafiss rafiss closed this as completed Jul 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rafiss rafiss

Labels
C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. sync-me-8 T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@jlinder @rafiss @tbg @cockroach-teamcity