Bump Docker to 19.03

[dm0-]

No description provided.

[dm0-]

This is blocked on various random segfaults and Go runtime OOM errors present in 18.09.

[dm0-]

I've updated this to 18.09.2 which has the CVE-2019-5736 fix built into it, but it still has random segfaults and runtime OOM errors.

[jansmets]

Do we already know what causes the segfaults/OOM, is there any bug report for it?

[dm0-]

@jansmets I haven't looked at it in a while, but I don't see any bug reports that seem related at the moment. I've rebased this PR if you want to look into it.

Most failures look like this:

/run/torcx/bin/docker: Error response from daemon: OCI runtime create failed: container_linux.go:344: starting container process caused "process_linux.go:424: container init caused "process_linux.go:407: running prestart hook 0 caused \"error running hook: signal: segmentation fault, stdout: , stderr: \""": unknown.

Or this:

/run/torcx/bin/docker: Error response from daemon: OCI runtime create failed: container_linux.go:344: starting container process caused "process_linux.go:424: container init caused "process_linux.go:407: running prestart hook 0 caused \"error running hook: exit status 2, stdout: , stderr: fatal error: runtime: out of memory\\n\\nruntime stack:\\nruntime.throw(0x5637a2dea9f5, 0x16)\\n\\t/usr/lib/go1.10/src/runtime/panic.go:616 +0x83\\nruntime.sysMap(0xc420700000, 0x100000, 0x5637a1810c00, 0x5637a469ee98)\\n\\t/usr/lib/go1.10/src/runtime/mem_linux.go:216 +0x20c\\nruntime.(*mheap).sysAlloc(0x5637a46841c0, 0x100000, 0x7f741d929220)\\n\\t/usr/lib/go1.10/src/runtime/malloc.go:470 +0xd6\\nruntime.(*mheap).grow(0x5637a46841c0, 0x8, 0x0)\\n\\t/usr/lib/go1.10/src/runtime/mheap.go:907 +0x62\\nruntime.(*mheap).allocSpanLocked(0x5637a46841c0, 0x8, 0x5637a469eea8, 0x7f741d929188)\\n\\t/usr/lib/go1.10/src/runtime/mheap.go:820 +0x303\\nruntime.(*mheap).alloc_m(0x5637a46841c0, 0x8, 0x5637a467007c, 0x7f741d929188)\\n\\t/usr/lib/go1.10/src/runtime/mheap.go:686 +0x11c\\nruntime.(*mheap).alloc.func1()\\n\\t/usr/lib/go1.10/src/runtime/mheap.go:753 +0x4f\\nruntime.(*mheap).alloc(0x5637a46841c0, 0x8, 0x7f741d01007c, 0x7f741d929188)\\n\\t/usr/lib/go1.10/src/runtime/mheap.go:752 +0x8c\\nruntime.(*mcentral).grow(0x5637a4687410, 0x0)\\n\\t/usr/lib/go1.10/src/runtime/mcentral.go:232 +0x96\\nruntime.(*mcentral).cacheSpan(0x5637a4687410, 0x7f741d929188)\\n\\t/usr/lib/go1.10/src/runtime/mcentral.go:106 +0x2e6\\nruntime.(*mcache).refill(0x7f741d96b000, 0x7f741d92977c)\\n\\t/usr/lib/go1.10/src/runtime/mcache.go:123 +0xa0\\nruntime.(*mcache).nextFree.func1()\\n\\t/usr/lib/go1.10/src/runtime/malloc.go:556 +0x34\\nruntime.systemstack(0x563700000000)\\n\\t/usr/lib/go1.10/src/runtime/asm_amd64.s:409 +0x72\\nruntime.mstart()\\n\\t/usr/lib/go1.10/src/runtime/proc.go:1175\\n\\ngoroutine 1 [running, locked to thread]:\\nruntime.systemstack_switch()\\n\\t/usr/lib/go1.10/src/runtime/asm_amd64.s:363 fp=0xc42062f5c8 sp=0xc42062f5c0 pc=0x5637a1832650\\nruntime.(*mcache).nextFree(0x7f741d96b000, 0xc42062f57c, 0xc42062f5a8, 0x52, 0x2900000000)\\n\\t/usr/lib/go1.10/src/runtime/malloc.go:555 +0xab fp=0xc42062f620 sp=0xc42062f5c8 pc=0x5637a17ea40b\\nruntime.mallocgc(0x5500, 0x5637a385c320, 0x101, 0xc4205a9d70)\\n\\t/usr/lib/go1.10/src/runtime/malloc.go:710 +0x7b1 fp=0xc42062f6c0 sp=0xc42062f620 pc=0x5637a17ead71\\nruntime.growslice(0x5637a385c320, 0xc4206f2000, 0x110, 0x110, 0x111, 0x5637a18e962a, 0x29, 0x5c)\\n\\t/usr/lib/go1.10/src/runtime/slice.go:179 +0x14c fp=0xc42062f728 sp=0xc42062f6c0 pc=0x5637a181c5ac\\nregexp/syntax.(*compiler).inst(...)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:173\\nregexp/syntax.(*compiler).quest(0xc42063bb08, 0x21f0000005d, 0x21f00000000, 0x10)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:228 +0x192 fp=0xc42062f7b0 sp=0xc42062f728 pc=0x5637a18ea552\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206edf10, 0xb80000005c)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdea fp=0xc42062fa20 sp=0xc42062f7b0 pc=0x5637a18e962a\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206edf80, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc42062fc90 sp=0xc42062fa20 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee000, 0xb60000005b)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc42062ff00 sp=0xc42062fc90 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee070, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420630170 sp=0xc42062ff00 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee0e0, 0xb40000005a)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc4206303e0 sp=0xc420630170 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee150, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420630650 sp=0xc4206303e0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee1c0, 0xb200000059)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc4206308c0 sp=0xc420630650 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee230, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420630b30 sp=0xc4206308c0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee2a0, 0xb000000058)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420630da0 sp=0xc420630b30 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee310, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420631010 sp=0xc420630da0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee380, 0xae00000057)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420631280 sp=0xc420631010 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee3f0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc4206314f0 sp=0xc420631280 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee460, 0xac00000056)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420631760 sp=0xc4206314f0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee4d0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc4206319d0 sp=0xc420631760 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee540, 0xaa00000055)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420631c40 sp=0xc4206319d0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee5b0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420631eb0 sp=0xc420631c40 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee620, 0xa800000054)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420632120 sp=0xc420631eb0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee690, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420632390 sp=0xc420632120 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee700, 0xa600000053)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420632600 sp=0xc420632390 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee770, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420632870 sp=0xc420632600 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee7e0, 0xa400000052)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420632ae0 sp=0xc420632870 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee850, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420632d50 sp=0xc420632ae0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee8c0, 0xa200000051)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420632fc0 sp=0xc420632d50 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee930, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420633230 sp=0xc420632fc0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ee9a0, 0xa000000050)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc4206334a0 sp=0xc420633230 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eea10, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420633710 sp=0xc4206334a0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eea80, 0x9e0000004f)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420633980 sp=0xc420633710 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eeaf0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420633bf0 sp=0xc420633980 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eeb60, 0x9c0000004e)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420633e60 sp=0xc420633bf0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eebd0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc4206340d0 sp=0xc420633e60 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eec40, 0x9a0000004d)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420634340 sp=0xc4206340d0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eecb0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc4206345b0 sp=0xc420634340 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eed20, 0x980000004c)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420634820 sp=0xc4206345b0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eed90, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420634a90 sp=0xc420634820 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eee00, 0x960000004b)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420634d00 sp=0xc420634a90 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eee70, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420634f70 sp=0xc420634d00 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eeee0, 0x940000004a)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc4206351e0 sp=0xc420634f70 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eef50, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420635450 sp=0xc4206351e0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eefc0, 0x9200000049)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc4206356c0 sp=0xc420635450 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef030, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420635930 sp=0xc4206356c0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef0a0, 0x9000000048)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420635ba0 sp=0xc420635930 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef110, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420635e10 sp=0xc420635ba0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef180, 0x8e00000047)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420636080 sp=0xc420635e10 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef1f0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc4206362f0 sp=0xc420636080 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef260, 0x8c00000046)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420636560 sp=0xc4206362f0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef2d0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc4206367d0 sp=0xc420636560 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef340, 0x8a00000045)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420636a40 sp=0xc4206367d0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef3b0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420636cb0 sp=0xc420636a40 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef420, 0x8800000044)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420636f20 sp=0xc420636cb0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef490, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420637190 sp=0xc420636f20 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef500, 0x8600000043)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420637400 sp=0xc420637190 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef570, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420637670 sp=0xc420637400 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef5e0, 0x8400000042)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc4206378e0 sp=0xc420637670 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef650, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420637b50 sp=0xc4206378e0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef6c0, 0x8200000041)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420637dc0 sp=0xc420637b50 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef730, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420638030 sp=0xc420637dc0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef7a0, 0x8000000040)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc4206382a0 sp=0xc420638030 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef810, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420638510 sp=0xc4206382a0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef880, 0x7e0000003f)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420638780 sp=0xc420638510 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef8f0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc4206389f0 sp=0xc420638780 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef960, 0x7c0000003e)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420638c60 sp=0xc4206389f0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206ef9d0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420638ed0 sp=0xc420638c60 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efa40, 0x7a0000003d)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420639140 sp=0xc420638ed0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efab0, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc4206393b0 sp=0xc420639140 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efb20, 0x780000003c)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420639620 sp=0xc4206393b0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efb90, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420639890 sp=0xc420639620 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efc00, 0x760000003b)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420639b00 sp=0xc420639890 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efc70, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc420639d70 sp=0xc420639b00 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efce0, 0x740000003a)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc420639fe0 sp=0xc420639d70 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efd50, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc42063a250 sp=0xc420639fe0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efdc0, 0x7200000039)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc42063a4c0 sp=0xc42063a250 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efe30, 0xa)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc42063a730 sp=0xc42063a4c0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206efea0, 0x7000000038)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc42063a9a0 sp=0xc42063a730 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eff10, 0x8)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc42063ac10 sp=0xc42063a9a0 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206eff80, 0x6e00000037)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc42063ae80 sp=0xc42063ac10 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206f0000, 0x1)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc42063b0f0 sp=0xc42063ae80 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206f0070, 0x6a00000035)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:138 +0x1507 fp=0xc42063b360 sp=0xc42063b0f0 pc=0x5637a18e9d47\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206f00e0, 0x6800000034)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc42063b5d0 sp=0xc42063b360 pc=0x5637a18e9366\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206f0150, 0x6800000001)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:146 +0xdad fp=0xc42063b840 sp=0xc42063b5d0 pc=0x5637a18e95ed\\nregexp/syntax.(*compiler).compile(0xc42063bb08, 0xc4206f01c0, 0x0)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:156 +0xb26 fp=0xc42063bab0 sp=0xc42063b840 pc=0x5637a18e9366\\nregexp/syntax.Compile(0xc4206f01c0, 0xc4206f01c0, 0x4, 0x4)\\n\\t/usr/lib/go1.10/src/regexp/syntax/compile.go:83 +0x10c fp=0xc42063bb78 sp=0xc42063bab0 pc=0x5637a18e861c\\nregexp.compile(0xc4200a66e0, 0x151, 0xd4, 0x151, 0xc4200a66e0, 0x151)\\n\\t/usr/lib/go1.10/src/regexp/regexp.go:178 +0xc9 fp=0xc42063bc00 sp=0xc42063bb78 pc=0x5637a18ff879\\nregexp.Compile(0xc4200a66e0, 0x151, 0x4f, 0x1, 0xc4200a66e0)\\n\\t/usr/lib/go1.10/src/regexp/regexp.go:133 +0x43 fp=0xc42063bc40 sp=0xc42063bc00 pc=0x5637a18ff763\\nregexp.MustCompile(0xc4200a66e0, 0x151, 0x102)\\n\\t/usr/lib/go1.10/src/regexp/regexp.go:238 +0x4f fp=0xc42063bcd8 sp=0xc42063bc40 pc=0x5637a18ffdef\\ngithub.com/docker/docker/vendor/github.com/docker/distribution/reference.expression(0xc420666ee0, 0x3, 0x3, 0xc4206e2320)\\n\\t/build/amd64-usr/var/tmp/portage/app-emulation/docker-18.09.2/work/docker-18.09.2/src/github.com/docker/docker/vendor/github.com/docker/distribution/reference/regexp.go:115 +0x96 fp=0xc42063bd28 sp=0xc42063bcd8 pc=0x5637a1d2d116\\ngithub.com/docker/docker/vendor/github.com/docker/distribution/reference.anchored(0xc420666ee0, 0x3, 0x3, 0xc4206e2320)\\n\\t/build/amd64-usr/var/tmp/portage/app-emulation/docker-18.09.2/work/docker-18.09.2/src/github.com/docker/docker/vendor/github.com/docker/distribution/reference/regexp.go:142 +0x45 fp=0xc42063bd88 sp=0xc42063bd28 pc=0x5637a1d2d545\\ngithub.com/docker/docker/vendor/github.com/docker/distribution/reference.init()\\n\\t/build/amd64-usr/var/tmp/portage/app-emulation/docker-18.09.2/work/docker-18.09.2/src/github.com/docker/docker/vendor/github.com/docker/distribution/reference/regexp.go:68 +0xe4c fp=0xc42063bdf8 sp=0xc42063bd88 pc=0x5637a1d2e42c\\ngithub.com/docker/docker/vendor/github.com/docker/distribution.init()\\n\\t:1 +0x66 fp=0xc42063be28 sp=0xc42063bdf8 pc=0x5637a1d30926\\ngithub.com/docker/docker/vendor/github.com/docker/distribution/registry/client.init()\\n\\t:1 +0x70 fp=0xc42063be58 sp=0xc42063be28 pc=0x5637a1db2430\\ngithub.com/docker/docker/vendor/github.com/docker/distribution/registry/client/auth.init()\\n\\t:1 +0x70 fp=0xc42063be88 sp=0xc42063be58 pc=0x5637a1db6da0\\ngithub.com/docker/docker/registry.init()\\n\\t:1 +0x66 fp=0xc42063bf08 sp=0xc42063be88 pc=0x5637a1deaca6\\ngithub.com/docker/docker/daemon/config.init()\\n\\t:1 +0x98 fp=0xc42063bf58 sp=0xc42063bf08 pc=0x5637a2188a98\\nmain.init()\\n\\t:1 +0x52 fp=0xc42063bf88 sp=0xc42063bf58 pc=0x5637a2dc2832\\nruntime.main()\\n\\t/usr/lib/go1.10/src/runtime/proc.go:186 +0x1d2 fp=0xc42063bfe0 sp=0xc42063bf88 pc=0x5637a1806fe2\\nruntime.goexit()\\n\\t/usr/lib/go1.10/src/runtime/asm_amd64.s:2361 +0x1 fp=0xc42063bfe8 sp=0xc42063bfe0 pc=0x5637a1835211\\n...additional frames elided...\\n\""": unknown.

[sbueringer]

Is there hope to get this working?

We're thinking about using containerd directly with Kubernetes and therefore hope for a newer containerd version in CoreOS than 1.1.2.

[dm0-]

I don't plan on investing any more time on it. If someone else wants to fix it, we can apply the update, otherwise there is not much benefit in devoting resources to it at this point in CL's lifetime. I could not reproduce the issue on other distros. (And the problems persist on the 19.03 beta.)

If you just want containerd updated, you could use this PR as a starting point to make a custom torcx image. Here are docs you can try for hosting it:

https://github.com/coreos/docs/blob/8cce6cf29766d307109bdc295954ac8892e2a7e0/os/torcx-hosting-custom-remotes.md
https://github.com/coreos/docs/blob/67850aca32d4c6b3a0431357788173d545ec9bc9/os/torcx-using-custom-remotes.md

[dm0-]

I had updated this branch to the 19.03 RCs to run it through kola while I was still maintaining Docker for Fedora, so I just updated the commits to push this last update before closing the issue as WONTFIX in case anyone wants to pick up the issue for their own purposes.