sentry: fetcher.go:1646: transaction committed but schema change aborted with error: (×): Non-nullable column "×:×" with no value! Index scanned was × with the index key columns (×) and the values (×) -- *err...

[cockroach-teamcity]

This issue was autofiled by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry link: https://sentry.io/organizations/cockroach-labs/issues/3823623277/?referrer=webhooks_plugin

Panic message:

fetcher.go:1646: transaction committed but schema change aborted with error: (×): Non-nullable column "×:×" with no value! Index scanned was × with the index key columns (×) and the values (×)
--
*errutil.leafError: Non-nullable column "×:×" with no value! Index scanned was × with the index key columns (×) and the values (×) (1)
fetcher.go:1646: *withstack.withStack (top exception)
*assert.withAssertionFailure
*errutil.withPrefix: transaction committed but schema change aborted with error: (×) (2)
conn_executor.go:2667: *withstack.withStack (3)
*pgerror.withCandidateCode: XXA00 (4)
*hintdetail.withHint
*issuelink.withIssueLink: #42061 (5)
(check the extra data payloads)

Stacktrace (expand for inline code snippets):

cockroach/pkg/sql/conn_executor.go

Lines 2666 to 2668 in af7f257

	// error message, in case it was a serious error.
	newErr := pgerror.Wrapf(err,
	pgcode.TransactionCommittedWithSchemaChangeFailure,

in pkg/sql.(*connExecutor).txnStateTransitionsApplyWrapper.func1

cockroach/pkg/sql/conn_executor.go

Lines 2686 to 2688 in af7f257

	ex.extraTxnState.jobs); err != nil {
	handleErr(err)
	}

in pkg/sql.(*connExecutor).txnStateTransitionsApplyWrapper

cockroach/pkg/sql/conn_executor.go

Lines 1857 to 1859 in af7f257

	var err error
	advInfo, err = ex.txnStateTransitionsApplyWrapper(ev, payload, res, pos)
	if err != nil {

in pkg/sql.(*connExecutor).execCmd

cockroach/pkg/sql/conn_executor.go

Lines 1630 to 1632 in af7f257

	var err error
	if err = ex.execCmd(ex.Ctx()); err != nil {
	if errors.IsAny(err, io.EOF, errDrainingComplete) {

in pkg/sql.(*connExecutor).run

cockroach/pkg/sql/conn_executor.go

Lines 669 to 671 in af7f257

	}()
	return h.ex.run(ctx, s.pool, reserved, cancel)
	}

in pkg/sql.(*Server).ServeConn

cockroach/pkg/sql/pgwire/conn.go

Lines 647 to 649 in af7f257

	reservedOwned = false // We're about to pass ownership away.
	retErr = sqlServer.ServeConn(ctx, connHandler, reserved, cancelConn)
	}()

in pkg/sql/pgwire.(*conn).processCommandsAsync.func1
/usr/local/go/src/runtime/asm_amd64.s#L1370-L1372 in runtime.goexit

pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).txnStateTransitionsApplyWrapper.func1 at line 2667
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).txnStateTransitionsApplyWrapper at line 2687
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd at line 1858
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).run at line 1631
pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn at line 670
pkg/sql/pgwire/conn.go in pkg/sql/pgwire.(*conn).processCommandsAsync.func1 at line 648
/usr/local/go/src/runtime/asm_amd64.s in runtime.goexit at line 1371

Tag	Value
Cockroach Release	v21.2.2
Cockroach SHA:	af7f257
Platform	darwin amd64
Distribution	CCL
Environment	development
Command	start-single-node
Go Version	``
# of CPUs
# of Goroutines

Jira issue: CRDB-22609

[yuzefovich]

unactionable