runtime: corruption in tests #55167

rsc · 2022-09-20T03:59:28Z

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

This issue gathers flakes caused by runtime.throw, which should "never happen" and usually indicates some kind of corruption.

The text was updated successfully, but these errors were encountered:

gopherbot · 2022-09-20T04:01:22Z

Found new matching flaky dashboard failures for:

#!watchflakes
post <- `runtime.throw\(` || `fatal error:`

2022-08-08 14:11 windows-386-2012 go@6e9925c4 runtime (log)

Exception 0xc7 0xcccccccc 0xcccccccc 0x0
PC=0x0

fatal error: unexpected signal during runtime execution
[signal 0xc0000005 code=0x0 addr=0x0 pc=0x465d7a]

runtime stack:
runtime.throw({0x7f14e7, 0x2a})
	C:/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x328ffbdc sp=0x328ffbc8 pc=0x44047d
runtime.sigpanic()
...
fatal error: unexpected signal during runtime execution
panic during panic
[signal 0xc0000005 code=0x0 addr=0x0 pc=0x46631f]

runtime stack:
runtime.throw({0x7f14e7, 0x2a})
	C:/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x328ff824 sp=0x328ff810 pc=0x44047d
runtime.sigpanic()
	C:/workdir/go/src/runtime/signal_windows.go:250 +0x23b fp=0x328ff848 sp=0x328ff824 pc=0x455fab
runtime.gentraceback(0xffffffff, 0xffffffff, 0x0, 0x142ca4b0, 0x0, 0x0, 0x64, 0x0, 0x0, 0x0)
...
	C:/workdir/go/src/runtime/traceback.go:846 +0x1a2 fp=0x328ffef0 sp=0x328ffe10 pc=0x468562
runtime.tracebacktrap(0x0, 0x0, 0x0, 0x142ca4b0)
	C:/workdir/go/src/runtime/traceback.go:810 +0x7e fp=0x328fff08 sp=0x328ffef0 pc=0x4683ae
runtime.winthrow(0x750df4, 0x12860ad0, 0x142ca4b0)
	C:/workdir/go/src/runtime/signal_windows.go:235 +0x202 fp=0x328fff34 sp=0x328fff08 pc=0x4559b2
runtime.lastcontinuehandler(0x750df4, 0x12860ad0, 0x142ca4b0)
	C:/workdir/go/src/runtime/signal_windows.go:198 +0x58 fp=0x328fff44 sp=0x328fff34 pc=0x455798
sigtramp()
	C:/workdir/go/src/runtime/sys_windows_386.s:127 +0x77 fp=0x328fff48 sp=0x328fff44 pc=0x477657
*** Test killed: ran too long (6m0s).

2022-08-08 16:57 js-wasm go@b589208c go/internal/gcimporter (log)

runtime: marked free object in span 0x369ed8, elemsize=5376 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
0x456000 alloc marked  
0x457500 free  unmarked
0x458a00 free  marked   zombie
0x0000000000458a00:  0x544f4f524f472420  0x2f6f672f6372732f 
0x0000000000458a10:  0x2f72656e6e616373  0x672e73726f727265 
0x0000000000458a20:  0x5008736f5003006f  0x086e6f697469736f 
0x0000000000458a30:  0x6e656b6f742f6f67  0x7272450567734d03 
0x0000000000458a40:  0x637365066501726f  0x016464410301003a 
0x0000000000458a50:  0x4c726f7272450970  0x03736f7003747369 
...
fatal error: found pointer to free object

goroutine 3 [running]:
runtime.throw({0x7d89b, 0x1c})
	/workdir/go/src/runtime/panic.go:1047 +0x3 fp=0x4315e0 sp=0x4315b8 pc=0x12460003
runtime.(*mspan).reportZombies(0x369ed8)
	/workdir/go/src/runtime/mgcsweep.go:788 +0x60 fp=0x431660 sp=0x4315e0 pc=0x118b0060
runtime.(*sweepLocked).sweep(0x431780, 0x0)
	/workdir/go/src/runtime/mgcsweep.go:607 +0x5f fp=0x431748 sp=0x431660 pc=0x118a005f
runtime.sweepone()
	/workdir/go/src/runtime/mgcsweep.go:370 +0x18 fp=0x4317a8 sp=0x431748 pc=0x11880018
runtime.bgsweep(0x438000)
	/workdir/go/src/runtime/mgcsweep.go:282 +0x2c fp=0x4317d0 sp=0x4317a8 pc=0x1185002c
runtime.gcenable.func1()
	/workdir/go/src/runtime/mgc.go:178 +0x2 fp=0x4317e0 sp=0x4317d0 pc=0x110a0002
runtime.goexit()
	/workdir/go/src/runtime/asm_wasm.s:401 +0x1 fp=0x4317e8 sp=0x4317e0 pc=0x14350001
created by runtime.gcenable
	/workdir/go/src/runtime/mgc.go:178 +0x8

2022-08-08 16:58 js-wasm go@2493072d go/build (log)

runtime: marked free object in span 0xd7ef80, elemsize=288 freeindex=4 (bad use of unsafe.Pointer? try -d=checkptr)
0x676000 alloc unmarked
0x676120 alloc marked  
0x676240 alloc unmarked
0x676360 alloc unmarked
0x676480 free  unmarked
0x6765a0 free  marked   zombie
0x00000000006765a0:  0x0000000000000000  0x0000000000000000 
0x00000000006765b0:  0x0000000000000000  0x0000000000000000 
0x00000000006765c0:  0x0000000000000000  0x0000000000000000 
...
fatal error: found pointer to free object

runtime stack:
runtime.throw({0x558d1, 0x1c})
	/workdir/go/src/runtime/panic.go:1047 +0x3 fp=0x265d88 sp=0x265d60 pc=0x12430003
runtime.(*mspan).reportZombies(0xd7ef80)
	/workdir/go/src/runtime/mgcsweep.go:788 +0x60 fp=0x265e08 sp=0x265d88 pc=0x11880060
runtime.(*sweepLocked).sweep(0x265f10, 0x0)
	/workdir/go/src/runtime/mgcsweep.go:607 +0x5f fp=0x265ef0 sp=0x265e08 pc=0x1187005f
runtime.(*mcentral).uncacheSpan(0x24ccd0, 0xd7ef80)
...
runtime.gcMarkTermination()
	/workdir/go/src/runtime/mgc.go:1058 +0x6c fp=0x432f00 sp=0x432cf8 pc=0x1118006c
runtime.gcMarkDone()
	/workdir/go/src/runtime/mgc.go:918 +0x45 fp=0x432f58 sp=0x432f00 pc=0x11120045
runtime.gcBgMarkWorker()
	/workdir/go/src/runtime/mgc.go:1366 +0x66 fp=0x432fe0 sp=0x432f58 pc=0x111c0066
runtime.goexit()
	/workdir/go/src/runtime/asm_wasm.s:401 +0x1 fp=0x432fe8 sp=0x432fe0 pc=0x14360001
created by runtime.gcBgMarkStartWorkers
	/workdir/go/src/runtime/mgc.go:1158 +0x3

2022-08-08 17:36 linux-386-longtest go@ebf182c8 runtime/pprof (log)

runtime: pointer 0x616e6966 to unallocated span span.base()=0x8f78000 span.limit=0x8f79ff8 span.state=0
runtime: found in object at *(0x8d3a420+0x0)
object=0x8d3a420 s.base()=0x8d3a000 s.limit=0x8d3c000 s.spanclass=5 s.elemsize=16 s.state=mSpanInUse
 *(object+0) = 0x616e6966 <==
 *(object+4) = 0x657a696c
 *(object+8) = 0x8114ed7
 *(object+12) = 0x0
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x81d8da0, 0x3e})
	/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x8c53e2c sp=0x8c53e18 pc=0x807fbdd
runtime.badPointer(0xef804360, 0x616e6966, 0x8d3a420, 0x0)
	/workdir/go/src/runtime/mbitmap.go:316 +0xa2 fp=0x8c53e4c sp=0x8c53e2c pc=0x8058f12
runtime.findObject(0x616e6966, 0x8d3a420, 0x0)
	/workdir/go/src/runtime/mbitmap.go:359 +0x9e fp=0x8c53e64 sp=0x8c53e4c pc=0x805916e
runtime.scanobject(0x8d3a420, 0x8c2895c)
	/workdir/go/src/runtime/mgcmark.go:1341 +0x183 fp=0x8c53eb4 sp=0x8c53e64 pc=0x8065613
runtime.markrootSpans(0x8c2895c, 0x0)
	/workdir/go/src/runtime/mgcmark.go:390 +0x18e fp=0x8c53ef0 sp=0x8c53eb4 pc=0x80630fe
runtime.markroot(0x8c2895c, 0x4, 0x1)
	/workdir/go/src/runtime/mgcmark.go:192 +0xe9 fp=0x8c53f4c sp=0x8c53ef0 pc=0x80628c9
runtime.gcDrain(0x8c2895c, 0x3)
	/workdir/go/src/runtime/mgcmark.go:1069 +0x4ed fp=0x8c53fb0 sp=0x8c53f4c pc=0x8064ffd
runtime.gcBgMarkWorker.func2()
	/workdir/go/src/runtime/mgc.go:1307 +0xaa fp=0x8c53fdc sp=0x8c53fb0 pc=0x806060a
runtime.systemstack()
	/workdir/go/src/runtime/asm_386.s:370 +0x41 fp=0x8c53fe0 sp=0x8c53fdc pc=0x80af4e1

2022-08-08 17:39 js-wasm go@d42b520b go/internal/gcimporter (log)

runtime: marked free object in span 0x369a10, elemsize=2304 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
0x46c000 alloc marked  
0x46c900 free  unmarked
0x46d200 free  unmarked
0x46db00 free  unmarked
0x46e400 free  marked   zombie
0x000000000046e400:  0x0000000000000000  0x0000000000000000 
0x000000000046e410:  0x0000000000000000  0x0000000000000000 
0x000000000046e420:  0x0000000000000000  0x0000000000000000 
0x000000000046e430:  0x0000000000000000  0x0000000000000000 
...
fatal error: found pointer to free object

goroutine 3 [running]:
runtime.throw({0x7d888, 0x1c})
	/workdir/go/src/runtime/panic.go:1047 +0x3 fp=0x4315e0 sp=0x4315b8 pc=0x12460003
runtime.(*mspan).reportZombies(0x369a10)
	/workdir/go/src/runtime/mgcsweep.go:788 +0x60 fp=0x431660 sp=0x4315e0 pc=0x118b0060
runtime.(*sweepLocked).sweep(0x431780, 0x0)
	/workdir/go/src/runtime/mgcsweep.go:607 +0x5f fp=0x431748 sp=0x431660 pc=0x118a005f
runtime.sweepone()
	/workdir/go/src/runtime/mgcsweep.go:370 +0x18 fp=0x4317a8 sp=0x431748 pc=0x11880018
runtime.bgsweep(0x438000)
	/workdir/go/src/runtime/mgcsweep.go:282 +0x2c fp=0x4317d0 sp=0x4317a8 pc=0x1185002c
runtime.gcenable.func1()
	/workdir/go/src/runtime/mgc.go:178 +0x2 fp=0x4317e0 sp=0x4317d0 pc=0x110a0002
runtime.goexit()
	/workdir/go/src/runtime/asm_wasm.s:401 +0x1 fp=0x4317e8 sp=0x4317e0 pc=0x14350001
created by runtime.gcenable
	/workdir/go/src/runtime/mgc.go:178 +0x8

2022-08-08 17:39 js-wasm go@d02d5fda go/internal/gcimporter (log)

runtime: pointer 0x7e42a0 to unused region of span span.base()=0x522000 span.limit=0x526000 span.state=1
runtime: found in object at *(0x424f00+0x90)
object=0x424f00 s.base()=0x41e000 s.limit=0x42be00 s.spanclass=104 s.elemsize=9472 s.state=mSpanInUse
 *(object+0) = 0x8fd8
 *(object+8) = 0x6e63d0
 *(object+16) = 0xc
 *(object+24) = 0x6e67d0
 *(object+32) = 0xa
 *(object+40) = 0x0
 *(object+48) = 0x0
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x8604a, 0x3e})
	/workdir/go/src/runtime/panic.go:1047 +0x3 fp=0x351220 sp=0x3511f8 pc=0x12460003
runtime.badPointer(0xdfb508, 0x7e42a0, 0x424f00, 0x90)
	/workdir/go/src/runtime/mbitmap.go:316 +0xe fp=0x351260 sp=0x351220 pc=0x10dc000e
runtime.findObject(0x7e42a0, 0x424f00, 0x90)
	/workdir/go/src/runtime/mbitmap.go:359 +0x1d fp=0x351290 sp=0x351260 pc=0x10dd001d
runtime.scanobject(0x424f00, 0x41f240)
	/workdir/go/src/runtime/mgcmark.go:1341 +0x32 fp=0x351328 sp=0x351290 pc=0x11460032
runtime.gcDrain(0x41f240, 0x7)
	/workdir/go/src/runtime/mgcmark.go:1103 +0x35 fp=0x351380 sp=0x351328 pc=0x11430035
runtime.gcBgMarkWorker.func2()
	/workdir/go/src/runtime/mgc.go:1326 +0x8 fp=0x3513d8 sp=0x351380 pc=0x11200008
runtime.systemstack()
	/workdir/go/src/runtime/asm_wasm.s:169 +0x2 fp=0x3513e0 sp=0x3513d8 pc=0x140c0002
runtime.mstart()
	/workdir/go/src/runtime/asm_wasm.s:27 fp=0x3513e8 sp=0x3513e0 pc=0x14080000

2022-08-09 14:33 js-wasm go@0981d9ff go/build (log)

runtime: pointer 0x737973 to unused region of span span.base()=0x498000 span.limit=0x49a000 span.state=1
runtime: found in object at *(0x61c560+0x8)
object=0x61c560 s.base()=0x61c000 s.limit=0x61e000 s.spanclass=5 s.elemsize=16 s.state=mSpanInUse
 *(object+0) = 0x7ff8000100001eb1
 *(object+8) = 0x737973 <==
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x5b8ee, 0x3e})
	/workdir/go/src/runtime/panic.go:1047 +0x3 fp=0x265e00 sp=0x265dd8 pc=0x12430003
runtime.badPointer(0xcbd0a8, 0x737973, 0x61c560, 0x8)
	/workdir/go/src/runtime/mbitmap.go:316 +0xe fp=0x265e40 sp=0x265e00 pc=0x10d9000e
runtime.findObject(0x737973, 0x61c560, 0x8)
	/workdir/go/src/runtime/mbitmap.go:359 +0x1d fp=0x265e70 sp=0x265e40 pc=0x10da001d
runtime.scanobject(0x61c560, 0x41f240)
	/workdir/go/src/runtime/mgcmark.go:1341 +0x32 fp=0x265f08 sp=0x265e70 pc=0x11430032
runtime.markrootSpans(0x41f240, 0x0)
	/workdir/go/src/runtime/mgcmark.go:390 +0x34 fp=0x265f80 sp=0x265f08 pc=0x11360034
runtime.markroot(0x41f240, 0x4, 0x1)
	/workdir/go/src/runtime/mgcmark.go:192 +0x1d fp=0x266028 sp=0x265f80 pc=0x1132001d
runtime.gcDrain(0x41f240, 0xb)
	/workdir/go/src/runtime/mgcmark.go:1069 +0x66 fp=0x266080 sp=0x266028 pc=0x11400066
runtime.gcBgMarkWorker.func2()
	/workdir/go/src/runtime/mgc.go:1324 +0xa fp=0x2660d8 sp=0x266080 pc=0x111d000a
runtime.systemstack()
	/workdir/go/src/runtime/asm_wasm.s:169 +0x2 fp=0x2660e0 sp=0x2660d8 pc=0x140d0002
runtime.mstart()
	/workdir/go/src/runtime/asm_wasm.s:27 fp=0x2660e8 sp=0x2660e0 pc=0x14090000

2022-08-09 15:13 js-wasm go@0d9ed063 go/internal/gcimporter (log)

runtime: marked free object in span 0x36b968, elemsize=10240 freeindex=1 (bad use of unsafe.Pointer? try -d=checkptr)
0x4aa000 alloc unmarked
0x4ac800 free  unmarked
0x4af000 free  unmarked
0x4b1800 free  marked   zombie
0x00000000004b1800:  0x0000000000000012  0x0000000000000000 
0x00000000004b1810:  0x0000000000000000  0x0000000000000000 
0x00000000004b1820:  0x0000000000000000  0x0000000000000000 
0x00000000004b1830:  0x0000000000000000  0x0000000000000000 
0x00000000004b1840:  0x0000a3585de23a8c  0x0000000000002bac 
...
fatal error: found pointer to free object

runtime stack:
runtime.throw({0x7d885, 0x1c})
	/workdir/go/src/runtime/panic.go:1047 +0x3 fp=0x351088 sp=0x351060 pc=0x12460003
runtime.(*mspan).reportZombies(0x36b968)
	/workdir/go/src/runtime/mgcsweep.go:788 +0x60 fp=0x351108 sp=0x351088 pc=0x118b0060
runtime.(*sweepLocked).sweep(0x351210, 0x0)
	/workdir/go/src/runtime/mgcsweep.go:607 +0x5f fp=0x3511f0 sp=0x351108 pc=0x118a005f
runtime.(*mcentral).uncacheSpan(0x33b4f0, 0x36b968)
...
runtime.gcMarkTermination()
	/workdir/go/src/runtime/mgc.go:1058 +0x6c fp=0x432f00 sp=0x432cf8 pc=0x111b006c
runtime.gcMarkDone()
	/workdir/go/src/runtime/mgc.go:918 +0x45 fp=0x432f58 sp=0x432f00 pc=0x11150045
runtime.gcBgMarkWorker()
	/workdir/go/src/runtime/mgc.go:1366 +0x66 fp=0x432fe0 sp=0x432f58 pc=0x111f0066
runtime.goexit()
	/workdir/go/src/runtime/asm_wasm.s:401 +0x1 fp=0x432fe8 sp=0x432fe0 pc=0x14350001
created by runtime.gcBgMarkStartWorkers
	/workdir/go/src/runtime/mgc.go:1158 +0x3

2022-08-09 16:09 js-wasm go@e1a8e0e0 go/internal/gcimporter (log)

runtime: marked free object in span 0x368228, elemsize=24 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
0x416000 alloc marked  
0x416018 alloc marked  
0x416030 alloc marked  
0x416048 alloc marked  
0x416060 alloc marked  
0x416078 alloc marked  
0x416090 alloc marked  
0x4160a8 alloc marked  
0x4160c0 alloc marked  
...
fatal error: found pointer to free object

goroutine 3 [running]:
runtime.throw({0x7d898, 0x1c})
	/workdir/go/src/runtime/panic.go:1047 +0x3 fp=0x4315e0 sp=0x4315b8 pc=0x12460003
runtime.(*mspan).reportZombies(0x368228)
	/workdir/go/src/runtime/mgcsweep.go:788 +0x60 fp=0x431660 sp=0x4315e0 pc=0x118b0060
runtime.(*sweepLocked).sweep(0x431780, 0x0)
	/workdir/go/src/runtime/mgcsweep.go:612 +0xfd fp=0x431748 sp=0x431660 pc=0x118a00fd
runtime.sweepone()
	/workdir/go/src/runtime/mgcsweep.go:370 +0x18 fp=0x4317a8 sp=0x431748 pc=0x11880018
runtime.bgsweep(0x438000)
	/workdir/go/src/runtime/mgcsweep.go:282 +0x2c fp=0x4317d0 sp=0x4317a8 pc=0x1185002c
runtime.gcenable.func1()
	/workdir/go/src/runtime/mgc.go:178 +0x2 fp=0x4317e0 sp=0x4317d0 pc=0x110a0002
runtime.goexit()
	/workdir/go/src/runtime/asm_wasm.s:401 +0x1 fp=0x4317e8 sp=0x4317e0 pc=0x14350001
created by runtime.gcenable
	/workdir/go/src/runtime/mgc.go:178 +0x8

2022-08-17 03:24 linux-amd64-staticlockranking go@c6be7103 cmd/trace (log)

207239  ======
0 : sysmon 1 0xd69998
1 : traceBuf 23 0xd80f98
2 : traceStackTab 42 0xd70ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe1ba?, 0x45eb45?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7ffe58068ed8 sp=0x7ffe58068ea8 pc=0x43a77d
...
cmd/trace.TestFoo(0xc000241520)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000052770 sp=0xc0000525b0 pc=0x751769
testing.tRunner(0xc000241520, 0xad0728)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000527c0 sp=0xc000052770 pc=0x51832b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000527e0 sp=0xc0000527c0 pc=0x5191ca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000527e8 sp=0xc0000527e0 pc=0x46f401
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-17 04:02 linux-amd64-staticlockranking go@c411886c cmd/trace (log)

206456  ======
0 : sysmon 1 0xd69998
1 : traceBuf 23 0xd80f98
2 : traceStackTab 42 0xd70ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe1ba?, 0x45eb45?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fccea0d1c20 sp=0x7fccea0d1bf0 pc=0x43a77d
...
cmd/trace.TestFoo(0xc0002311e0)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000052770 sp=0xc0000525b0 pc=0x751769
testing.tRunner(0xc0002311e0, 0xad0728)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000527c0 sp=0xc000052770 pc=0x51832b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000527e0 sp=0xc0000527c0 pc=0x5191ca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000527e8 sp=0xc0000527e0 pc=0x46f401
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-17 16:26 linux-amd64-staticlockranking go@5b0ce94c cmd/trace (log)

205725  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe2ba?, 0x45eba5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f3aee48cc20 sp=0x7f3aee48cbf0 pc=0x43a7bd
...
cmd/trace.TestFoo(0xc000437520)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000051f70 sp=0xc000051db0 pc=0x751609
testing.tRunner(0xc000437520, 0xad0828)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc000051fc0 sp=0xc000051f70 pc=0x5181cb
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc000051fe0 sp=0xc000051fc0 pc=0x51906a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000051fe8 sp=0xc000051fe0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-17 16:48 linux-amd64-staticlockranking go@b11b4b4d cmd/trace (log)

206911  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe21a?, 0x45ebe5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fcd758b1c20 sp=0x7fcd758b1bf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc000231a00)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000053770 sp=0xc0000535b0 pc=0x751649
testing.tRunner(0xc000231a00, 0xad0788)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000537c0 sp=0xc000053770 pc=0x51820b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000537e0 sp=0xc0000537c0 pc=0x5190aa
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000537e8 sp=0xc0000537e0 pc=0x46f4a1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-17 17:40 linux-amd64-staticlockranking go@dea67a9b cmd/trace (log)

206798  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe21a?, 0x45ebe5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f9ff3d69c20 sp=0x7f9ff3d69bf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc00021dd40)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc00023f770 sp=0xc00023f5b0 pc=0x751669
testing.tRunner(0xc00021dd40, 0xad0788)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc00023f7c0 sp=0xc00023f770 pc=0x51820b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc00023f7e0 sp=0xc00023f7c0 pc=0x5190aa
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00023f7e8 sp=0xc00023f7e0 pc=0x46f4a1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-17 18:47 linux-amd64-staticlockranking go@57d05512 runtime/trace (log)

94330  ======
0 : traceStackTab 42 0x6fa658
1 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x5bd466?, 0x45d565?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fddef7fdc20 sp=0x7fddef7fdbf0 pc=0x4398dd
runtime.checkRanks(0xc0004036c0, 0x642358?, 0xffffffff000318ff?)
	/workdir/go/src/runtime/lockrank_on.go:156 +0x21a fp=0x7fddef7fdc80 sp=0x7fddef7fdc20 pc=0x40d93a
...
	/workdir/go/src/runtime/trace/trace_test.go:374 +0x125 fp=0xc0000537e0 sp=0xc0000536c8 pc=0x569de5
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000537e8 sp=0xc0000537e0 pc=0x46d581
created by runtime/trace_test.TestTraceStressStartStop
	/workdir/go/src/runtime/trace/trace_test.go:360 +0x12b

goroutine 19 [running]:
	goroutine running on other thread; stack unavailable
created by runtime.gcenable
	/workdir/go/src/runtime/mgc.go:179 +0xaa

2022-08-17 20:19 freebsd-amd64-12_3 go@9c2b481b compress/flate (log)

runtime: pointer 0xc0014a6000 to unallocated span span.base()=0xc0014a6000 span.limit=0xc0014c6020 span.state=0
runtime: found in object at *(0xc0012d6000+0x18058)
object=0xc0012d6000 s.base()=0xc001276000 s.limit=0xc001316508 s.spanclass=0 s.elemsize=663552 s.state=mSpanInUse
 *(object+0) = 0x0
 *(object+8) = 0x0
 *(object+16) = 0x0
 *(object+24) = 0x0
 *(object+32) = 0x0
 *(object+40) = 0x0
 *(object+48) = 0x0
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x559f67?, 0x6?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0xc000055df8 sp=0xc000055dc8 pc=0x4347bd
runtime.badPointer(0x827ccaf60, 0xc000055e70?, 0xc0012d6000, 0xc000055f00?)
	/tmp/workdir/go/src/runtime/mbitmap.go:316 +0x150 fp=0xc000055e48 sp=0xc000055df8 pc=0x413390
runtime.findObject(0xc00095af00?, 0xc00002cf00?, 0xc00004a800?)
	/tmp/workdir/go/src/runtime/mbitmap.go:359 +0xa6 fp=0xc000055e80 sp=0xc000055e48 pc=0x413526
runtime.scanobject(0xc00002bc40?, 0xc00002bc40)
	/tmp/workdir/go/src/runtime/mgcmark.go:1335 +0x165 fp=0xc000055f10 sp=0xc000055e80 pc=0x41dd45
runtime.gcDrain(0xc00002bc40, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1105 +0x1d4 fp=0xc000055f70 sp=0xc000055f10 pc=0x41d5b4
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1307 +0xa5 fp=0xc000055fc0 sp=0xc000055f70 pc=0x419ca5
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0xc000055fc8 sp=0xc000055fc0 pc=0x464009

2022-08-17 23:18 linux-amd64-staticlockranking go@9709d92b cmd/trace (log)

208372  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe21a?, 0x45ebe5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7ffee1aee558 sp=0x7ffee1aee528 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc00021f380)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000053770 sp=0xc0000535b0 pc=0x751689
testing.tRunner(0xc00021f380, 0xad0788)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000537c0 sp=0xc000053770 pc=0x51822b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000537e0 sp=0xc0000537c0 pc=0x5190ca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000537e8 sp=0xc0000537e0 pc=0x46f4a1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 00:30 linux-amd64-staticlockranking go@b30ba3df cmd/trace (log)

207630  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe21a?, 0x45ebe5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7ff99abebc20 sp=0x7ff99abebbf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc000233ba0)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000235f70 sp=0xc000235db0 pc=0x751689
testing.tRunner(0xc000233ba0, 0xad0788)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc000235fc0 sp=0xc000235f70 pc=0x51822b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc000235fe0 sp=0xc000235fc0 pc=0x5190ca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000235fe8 sp=0xc000235fe0 pc=0x46f4a1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 02:51 linux-amd64-staticlockranking go@04d3d6bf cmd/trace (log)

208093  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe21a?, 0x45eba5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f83c6597c20 sp=0x7f83c6597bf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc000239520)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc00043af70 sp=0xc00043adb0 pc=0x751649
testing.tRunner(0xc000239520, 0xad0788)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc00043afc0 sp=0xc00043af70 pc=0x5181eb
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc00043afe0 sp=0xc00043afc0 pc=0x51908a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00043afe8 sp=0xc00043afe0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 05:32 linux-amd64-staticlockranking go@a2c2f06c cmd/trace (log)

208527  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe21a?, 0x45eba5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fa4fd396c20 sp=0x7fa4fd396bf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc0002236c0)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc0001cef70 sp=0xc0001cedb0 pc=0x751509
testing.tRunner(0xc0002236c0, 0xad0780)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0001cefc0 sp=0xc0001cef70 pc=0x5180ab
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0001cefe0 sp=0xc0001cefc0 pc=0x518f4a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0001cefe8 sp=0xc0001cefe0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 14:53 linux-amd64-staticlockranking go@741ab7e8 cmd/trace (log)

208246  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe21a?, 0x45eba5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fe77e206c20 sp=0x7fe77e206bf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc0000b8680)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc00022bf70 sp=0xc00022bdb0 pc=0x751509
testing.tRunner(0xc0000b8680, 0xad0780)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc00022bfc0 sp=0xc00022bf70 pc=0x5180ab
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc00022bfe0 sp=0xc00022bfc0 pc=0x518f4a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00022bfe8 sp=0xc00022bfe0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 16:12 linux-amd64-staticlockranking go@b8b9e83e cmd/trace (log)

207507  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe20f?, 0x45eba5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fd2627fbc20 sp=0x7fd2627fbbf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc0002a31e0)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000057770 sp=0xc0000575b0 pc=0x751229
testing.tRunner(0xc0002a31e0, 0xad0760)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000577c0 sp=0xc000057770 pc=0x517dcb
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000577e0 sp=0xc0000577c0 pc=0x518c6a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000577e8 sp=0xc0000577e0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 16:15 linux-amd64-staticlockranking go@c7c78f1a cmd/trace (log)

207221  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe20f?, 0x45eba5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fa458a76c20 sp=0x7fa458a76bf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc00022b520)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc0000bd770 sp=0xc0000bd5b0 pc=0x751229
testing.tRunner(0xc00022b520, 0xad0760)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000bd7c0 sp=0xc0000bd770 pc=0x517dcb
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000bd7e0 sp=0xc0000bd7c0 pc=0x518c6a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000bd7e8 sp=0xc0000bd7e0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 16:35 linux-amd64-staticlockranking go@b2c0417c cmd/trace (log)

207708  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe20f?, 0x45eba5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7ff11fffec20 sp=0x7ff11fffebf0 pc=0x43a7fd
...
cmd/trace.TestFoo(0xc000102340)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000053770 sp=0xc0000535b0 pc=0x7511e9
testing.tRunner(0xc000102340, 0xad0760)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000537c0 sp=0xc000053770 pc=0x517dcb
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000537e0 sp=0xc0000537c0 pc=0x518c6a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000537e8 sp=0xc0000537e0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 17:09 linux-amd64-staticlockranking go@c82bbc0e cmd/trace (log)

193599  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe38f?, 0x45ebc5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f0155ffac20 sp=0x7f0155ffabf0 pc=0x43a81d
...
cmd/trace.TestFoo(0xc000544680)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc0000c3770 sp=0xc0000c35b0 pc=0x751209
testing.tRunner(0xc000544680, 0xad08e0)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000c37c0 sp=0xc0000c3770 pc=0x517deb
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000c37e0 sp=0xc0000c37c0 pc=0x518c8a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000c37e8 sp=0xc0000c37e0 pc=0x46f481
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 17:26 linux-amd64-staticlockranking go@b23d469e cmd/trace (log)

208048  ======
0 : sysmon 1 0xd6a998
1 : traceBuf 23 0xd81f98
2 : traceStackTab 42 0xd71ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fe38f?, 0x45ebc5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fcfb1580c20 sp=0x7fcfb1580bf0 pc=0x43a81d
...
cmd/trace.TestFoo(0xc000541a00)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000053770 sp=0xc0000535b0 pc=0x751209
testing.tRunner(0xc000541a00, 0xad08e0)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000537c0 sp=0xc000053770 pc=0x517deb
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000537e0 sp=0xc0000537c0 pc=0x518c8a
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000537e8 sp=0xc0000537e0 pc=0x46f481
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 18:18 linux-amd64-staticlockranking go@1aa5730f cmd/trace (log)

207493  ======
0 : sysmon 1 0xd66998
1 : traceBuf 23 0xd7df98
2 : traceStackTab 42 0xd6def8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fb38f?, 0x45ec45?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f94ab536c20 sp=0x7f94ab536bf0 pc=0x43a87d
...
cmd/trace.TestFoo(0xc000103a00)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000052770 sp=0xc0000525b0 pc=0x74e029
testing.tRunner(0xc000103a00, 0xacd8d0)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000527c0 sp=0xc000052770 pc=0x51776b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000527e0 sp=0xc0000527c0 pc=0x5185ea
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000527e8 sp=0xc0000527e0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 21:22 linux-amd64-staticlockranking go@5fcddf39 cmd/trace (log)

208328  ======
0 : sysmon 1 0xd66998
1 : traceBuf 23 0xd7df98
2 : traceStackTab 42 0xd6def8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fb38f?, 0x45ec45?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f361c11ec20 sp=0x7f361c11ebf0 pc=0x43a87d
...
cmd/trace.TestFoo(0xc000225860)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc00032f770 sp=0xc00032f5b0 pc=0x74e029
testing.tRunner(0xc000225860, 0xacd8d0)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc00032f7c0 sp=0xc00032f770 pc=0x51776b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc00032f7e0 sp=0xc00032f7c0 pc=0x5185ea
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00032f7e8 sp=0xc00032f7e0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-18 21:54 linux-amd64-staticlockranking go@9ad77203 cmd/trace (log)

207715  ======
0 : sysmon 1 0xd66998
1 : traceBuf 23 0xd7df98
2 : traceStackTab 42 0xd6def8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7fb38f?, 0x45ec45?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f1039d76c20 sp=0x7f1039d76bf0 pc=0x43a87d
...
cmd/trace.TestFoo(0xc000103a00)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc00023f770 sp=0xc00023f5b0 pc=0x74e029
testing.tRunner(0xc000103a00, 0xacd8d0)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc00023f7c0 sp=0xc00023f770 pc=0x51776b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc00023f7e0 sp=0xc00023f7c0 pc=0x5185ea
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00023f7e8 sp=0xc00023f7e0 pc=0x46f461
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-19 01:34 linux-amd64-staticlockranking go@ee833ed7 cmd/trace (log)

210886  ======
0 : sysmon 1 0xd6c998
1 : traceBuf 23 0xd83f98
2 : traceStackTab 42 0xd73ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8f0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f4cb4169c20 sp=0x7f4cb4169bf0 pc=0x439e3d
...
cmd/trace.TestFoo(0xc000220b60)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000156770 sp=0xc0001565b0 pc=0x752e49
testing.tRunner(0xc000220b60, 0xad1df0)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0001567c0 sp=0xc000156770 pc=0x519b4b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0001567e0 sp=0xc0001567c0 pc=0x51a9ca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0001567e8 sp=0xc0001567e0 pc=0x46f4c1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-19 21:29 linux-amd64-staticlockranking go@375a80c9 cmd/trace (log)

211255  ======
0 : sysmon 1 0xd6c978
1 : traceBuf 23 0xd83f78
2 : traceStackTab 42 0xd73ed8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fe4ec2b8c20 sp=0x7fe4ec2b8bf0 pc=0x439e3d
...
cmd/trace.TestFoo(0xc000225860)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000052770 sp=0xc0000525b0 pc=0x752d89
testing.tRunner(0xc000225860, 0xad1d10)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000527c0 sp=0xc000052770 pc=0x519c4b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000527e0 sp=0xc0000527c0 pc=0x51aaca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000527e8 sp=0xc0000527e0 pc=0x46f4c1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-22 11:46 linux-amd64-staticlockranking go@9a9aad44 cmd/trace (log)

211003  ======
0 : sysmon 1 0xd6c998
1 : traceBuf 23 0xd83f98
2 : traceStackTab 42 0xd73ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7ff11fffec20 sp=0x7ff11fffebf0 pc=0x439e3d
...
cmd/trace.TestFoo(0xc0000db040)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000051770 sp=0xc0000515b0 pc=0x752d09
testing.tRunner(0xc0000db040, 0xad1d08)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0000517c0 sp=0xc000051770 pc=0x519c4b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0000517e0 sp=0xc0000517c0 pc=0x51aaca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000517e8 sp=0xc0000517e0 pc=0x46f4c1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-22 14:48 linux-amd64-staticlockranking go@6bdca820 cmd/trace (log)

210352  ======
0 : sysmon 1 0xd6c998
1 : traceBuf 23 0xd83f98
2 : traceStackTab 42 0xd73ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fd4fdf85c20 sp=0x7fd4fdf85bf0 pc=0x439e3d
...
cmd/trace.TestFoo(0xc0002b3860)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000225f70 sp=0xc000225db0 pc=0x752d09
testing.tRunner(0xc0002b3860, 0xad1d08)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc000225fc0 sp=0xc000225f70 pc=0x519c4b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc000225fe0 sp=0xc000225fc0 pc=0x51aaca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000225fe8 sp=0xc000225fe0 pc=0x46f4c1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-22 16:48 linux-amd64-staticlockranking go@a10da772 cmd/trace (log)

211392  ======
0 : sysmon 1 0xd6c998
1 : traceBuf 23 0xd83f98
2 : traceStackTab 42 0xd73ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fe6d67fbc20 sp=0x7fe6d67fbbf0 pc=0x439e3d
...
cmd/trace.TestFoo(0xc0002a1a00)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000247770 sp=0xc0002475b0 pc=0x752ca9
testing.tRunner(0xc0002a1a00, 0xad1d08)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0002477c0 sp=0xc000247770 pc=0x519c4b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0002477e0 sp=0xc0002477c0 pc=0x51aaca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002477e8 sp=0xc0002477e0 pc=0x46f4c1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-22 18:50 linux-amd64-staticlockranking go@e21c1f78 cmd/trace (log)

211500  ======
0 : sysmon 1 0xd6c998
1 : traceBuf 23 0xd83f98
2 : traceStackTab 42 0xd73ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f100b2bec20 sp=0x7f100b2bebf0 pc=0x439e3d
...
cmd/trace.TestFoo(0xc000543380)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc0001cf770 sp=0xc0001cf5b0 pc=0x752ca9
testing.tRunner(0xc000543380, 0xad1d08)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0001cf7c0 sp=0xc0001cf770 pc=0x519c4b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0001cf7e0 sp=0xc0001cf7c0 pc=0x51aaca
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0001cf7e8 sp=0xc0001cf7e0 pc=0x46f4c1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-23 03:09 linux-amd64-staticlockranking go@0a52d806 cmd/trace (log)

211043  ======
0 : sysmon 1 0xd6b998
1 : traceBuf 23 0xd82f98
2 : traceStackTab 42 0xd72ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f091fffec20 sp=0x7f091fffebf0 pc=0x439e3d
...
cmd/trace.TestFoo(0xc00020ed00)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000263770 sp=0xc0002635b0 pc=0x752a49
testing.tRunner(0xc00020ed00, 0xad1d08)
	/workdir/go/src/testing/testing.go:1446 +0x10b fp=0xc0002637c0 sp=0xc000263770 pc=0x519c2b
testing.(*T).Run.func1()
	/workdir/go/src/testing/testing.go:1493 +0x2a fp=0xc0002637e0 sp=0xc0002637c0 pc=0x51aaaa
runtime.goexit()
	/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002637e8 sp=0xc0002637e0 pc=0x46f4c1
created by testing.(*T).Run
	/workdir/go/src/testing/testing.go:1493 +0x35f

2022-08-26 17:48 darwin-amd64-10_14 go@296c40db compress/flate (log)

runtime: pointer 0xc000f68000 to unallocated span span.base()=0xc000f68000 span.limit=0xc000f77fff span.state=0
runtime: found in object at *(0xc0013c0000+0x0)
object=0xc0013c0000 s.base()=0xc0013a0000 s.limit=0xc001440508 s.spanclass=0 s.elemsize=663552 s.state=mSpanInUse
 *(object+0) = 0x0 <==
 *(object+8) = 0x0
 *(object+16) = 0x0
 *(object+24) = 0x0
 *(object+32) = 0x0
 *(object+40) = 0x0
 *(object+48) = 0x0
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x115b36f?, 0x6?})
	/var/folders/9w/4l2_g3kx01x199n37fbmv3s80000gn/T/workdir-host-darwin-amd64-10_14/go/src/runtime/panic.go:1047 +0x5d fp=0x7000090edce8 sp=0x7000090edcb8 pc=0x1033e7d
runtime.badPointer(0x1409a20, 0x7000090edd60?, 0xc0013c0000, 0x1024328?)
	/var/folders/9w/4l2_g3kx01x199n37fbmv3s80000gn/T/workdir-host-darwin-amd64-10_14/go/src/runtime/mbitmap.go:314 +0x150 fp=0x7000090edd38 sp=0x7000090edce8 pc=0x1013210
runtime.findObject(0xc0030c4000?, 0x102fcff?, 0xc000031738?)
	/var/folders/9w/4l2_g3kx01x199n37fbmv3s80000gn/T/workdir-host-darwin-amd64-10_14/go/src/runtime/mbitmap.go:357 +0xa6 fp=0x7000090edd70 sp=0x7000090edd38 pc=0x10133a6
runtime.scanobject(0xc000031738?, 0xc000031738)
	/var/folders/9w/4l2_g3kx01x199n37fbmv3s80000gn/T/workdir-host-darwin-amd64-10_14/go/src/runtime/mgcmark.go:1337 +0x165 fp=0x7000090ede00 sp=0x7000090edd70 pc=0x101d8c5
runtime.gcDrainN(0xc000031738, 0x10000)
	/var/folders/9w/4l2_g3kx01x199n37fbmv3s80000gn/T/workdir-host-darwin-amd64-10_14/go/src/runtime/mgcmark.go:1194 +0x192 fp=0x7000090ede30 sp=0x7000090ede00 pc=0x101d512
runtime.gcAssistAlloc1(0xc000117860, 0xc000331910?)
	/var/folders/9w/4l2_g3kx01x199n37fbmv3s80000gn/T/workdir-host-darwin-amd64-10_14/go/src/runtime/mgcmark.go:569 +0x12e fp=0x7000090ede98 sp=0x7000090ede30 pc=0x101bfae
runtime.gcAssistAlloc.func1()
	/var/folders/9w/4l2_g3kx01x199n37fbmv3s80000gn/T/workdir-host-darwin-amd64-10_14/go/src/runtime/mgcmark.go:476 +0x25 fp=0x7000090edeb8 sp=0x7000090ede98 pc=0x101be65
runtime.systemstack()
	/var/folders/9w/4l2_g3kx01x199n37fbmv3s80000gn/T/workdir-host-darwin-amd64-10_14/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x7000090edec0 sp=0x7000090edeb8 pc=0x1065309

2022-09-02 19:09 windows-arm64-10 go@55ca6a20 runtime/trace (log)

fatal error: unexpected signal during runtime execution
[signal 0xc0000005 code=0x0 addr=0x0 pc=0x7ff6f49eb8e4]

runtime stack:
runtime.throw({0x7ff6f4b4c65b?, 0x0?})
	C:/workdir/go/src/runtime/panic.go:1047 +0x40 fp=0xea793ff1b0 sp=0xea793ff180 pc=0x7ff6f49c73a0
runtime.sigpanic()
	C:/workdir/go/src/runtime/signal_windows.go:251 +0x220 fp=0xea793ff200 sp=0xea793ff1b0 pc=0x7ff6f49dcc90
runtime.gentraceback(0x4000041520?, 0x4000024000?, 0xea793ff5a8?, 0x40003c4000, 0x0, 0xea793ff5a8, 0x40, 0x0, 0x0?, 0x6)
	C:/workdir/go/src/runtime/traceback.go:162 +0x304 fp=0xea793ff540 sp=0xea793ff210 pc=0x7ff6f49eb8e4
runtime.sigprof(0x7ff6f49f71d8, 0x20c?, 0xea793ff7f0?, 0x40003c4000, 0x40003c0000)
	C:/workdir/go/src/runtime/proc.go:4626 +0xf8 fp=0xea793ff7b0 sp=0xea793ff540 pc=0x7ff6f49d3618
runtime.profilem(0x40003c0000, 0x20c?)
	C:/workdir/go/src/runtime/os_windows.go:1228 +0x110 fp=0xea793ffb90 sp=0xea793ff7b0 pc=0x7ff6f49c43d0
runtime.profileLoop()
	C:/workdir/go/src/runtime/os_windows.go:1284 +0x178 fp=0xea793ffc10 sp=0xea793ffb90 pc=0x7ff6f49c4578
runtime.mstart1()
	C:/workdir/go/src/runtime/proc.go:1425 +0x88 fp=0xea793ffc40 sp=0xea793ffc10 pc=0x7ff6f49cc308
runtime.mstart0()
	C:/workdir/go/src/runtime/proc.go:1382 +0x68 fp=0xea793ffc70 sp=0xea793ffc40 pc=0x7ff6f49cc268
runtime.mstart()
	C:/workdir/go/src/runtime/asm_arm64.s:128 +0x10 fp=0xea793ffc80 sp=0xea793ffc70 pc=0x7ff6f49f70a0

2022-09-05 08:08 windows-amd64-longtest go@af7f4176 runtime/pprof (log)

fatal error: unexpected signal during runtime execution
[signal 0xc0000005 code=0x0 addr=0x0 pc=0x3ac66f]

runtime stack:
runtime.throw({0x51017b?, 0x5e6150?})
	C:/workdir/go/src/runtime/panic.go:1047 +0x65 fp=0x69bd3fed18 sp=0x69bd3fece8 pc=0x388645
runtime.sigpanic()
	C:/workdir/go/src/runtime/signal_windows.go:251 +0x213 fp=0x69bd3fed60 sp=0x69bd3fed18 pc=0x39d453
runtime.gentraceback(0xffffffdccc0fa9c0?, 0x69bd3ff130?, 0x8?, 0xc000052820, 0x0, 0x69bd3ff130, 0x40, 0x0, 0x0?, 0x6)
	C:/workdir/go/src/runtime/traceback.go:162 +0x4cf fp=0x69bd3ff0d0 sp=0x69bd3fed60 pc=0x3ac66f
runtime.sigprof(0x3918bf, 0x198?, 0x69bd3ff370?, 0xc000052820, 0xc00005c800)
	C:/workdir/go/src/runtime/proc.go:4626 +0x11d fp=0x69bd3ff340 sp=0x69bd3ff0d0 pc=0x3944bd
runtime.profilem(0xc00005c800, 0x198?)
	C:/workdir/go/src/runtime/os_windows.go:1228 +0xff fp=0x69bd3ff860 sp=0x69bd3ff340 pc=0x38553f
runtime.profileLoop()
	C:/workdir/go/src/runtime/os_windows.go:1284 +0x1d2 fp=0x69bd3ff8d8 sp=0x69bd3ff860 pc=0x385752
runtime.mstart1()
	C:/workdir/go/src/runtime/proc.go:1425 +0x9d fp=0x69bd3ff900 sp=0x69bd3ff8d8 pc=0x38d7fd
runtime.mstart0()
	C:/workdir/go/src/runtime/proc.go:1382 +0x6c fp=0x69bd3ff928 sp=0x69bd3ff900 pc=0x38d72c
runtime.mstart()
	C:/workdir/go/src/runtime/asm_amd64.s:390 +0x5 fp=0x69bd3ff930 sp=0x69bd3ff928 pc=0x3b8305

2022-09-07 06:18 freebsd-amd64-13_0 go@6375f508 compress/flate (log)

runtime: pointer 0xc00191a000 to unused region of span span.base()=0xc000968000 span.limit=0xc000977fff span.state=1
runtime: found in object at *(0xc001828000+0x1c078)
object=0xc001828000 s.base()=0xc0017e8000 s.limit=0xc001888508 s.spanclass=0 s.elemsize=663552 s.state=mSpanInUse
 *(object+0) = 0x0
 *(object+8) = 0x0
 *(object+16) = 0x0
 *(object+24) = 0x0
 *(object+32) = 0x0
 *(object+40) = 0x0
 *(object+48) = 0x0
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x55a430?, 0x6?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0xc00005bdf8 sp=0xc00005bdc8 pc=0x433ebd
runtime.badPointer(0x827bb1898, 0xc00005be70?, 0xc001828000, 0x4242c8?)
	/tmp/workdir/go/src/runtime/mbitmap.go:314 +0x150 fp=0xc00005be48 sp=0xc00005bdf8 pc=0x413170
runtime.findObject(0xc0000141e0?, 0x0?, 0x0?)
	/tmp/workdir/go/src/runtime/mbitmap.go:357 +0xa6 fp=0xc00005be80 sp=0xc00005be48 pc=0x413306
runtime.scanobject(0xc000027238?, 0xc000027238)
	/tmp/workdir/go/src/runtime/mgcmark.go:1337 +0x165 fp=0xc00005bf10 sp=0xc00005be80 pc=0x41d865
runtime.gcDrain(0xc000027238, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1105 +0x1d4 fp=0xc00005bf70 sp=0xc00005bf10 pc=0x41d0d4
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1307 +0xa5 fp=0xc00005bfc0 sp=0xc00005bf70 pc=0x4197c5
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0xc00005bfc8 sp=0xc00005bfc0 pc=0x4642e9

2022-09-07 16:39 aix-ppc64 go@027ff3f4 (log)

runtime: pointer 0xa00010000664e00 to unallocated span span.base()=0xa00010000664000 span.limit=0xa00010000667f00 span.state=0
runtime: found in object at *(0xa000100000c4600+0x0)
object=0xa000100000c4600 s.base()=0xa000100000c4000 s.limit=0xa000100000c5e00 s.spanclass=72 s.elemsize=1536 s.state=mSpanInUse
 *(object+0) = 0x0 <==
 *(object+8) = 0x0
 *(object+16) = 0x0
 *(object+24) = 0x0
 *(object+32) = 0x0
 *(object+40) = 0x0
 *(object+48) = 0x0
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x100160e36, 0x3e})
	/ramdisk8GB/workdir-host-aix-ppc64-osuosl/go1.4/src/runtime/panic.go:1198 +0x68 fp=0x11027d508 sp=0x11027d4c8 pc=0x10003a0b8
runtime.badPointer(0xa00000026e74b00, 0xa00010000664e00, 0xa000100000c4600, 0x0)
	/ramdisk8GB/workdir-host-aix-ppc64-osuosl/go1.4/src/runtime/mbitmap.go:367 +0x174 fp=0x11027d560 sp=0x11027d508 pc=0x100014514
runtime.findObject(0xa00010000664e00, 0xa000100000c4600, 0x0)
	/ramdisk8GB/workdir-host-aix-ppc64-osuosl/go1.4/src/runtime/mbitmap.go:409 +0x104 fp=0x11027d5a8 sp=0x11027d560 pc=0x1000146d4
runtime.scanobject(0xa000100000c4600, 0xa0001000003be98)
	/ramdisk8GB/workdir-host-aix-ppc64-osuosl/go1.4/src/runtime/mgcmark.go:1280 +0x1ec fp=0x11027d648 sp=0x11027d5a8 pc=0x100020b8c
runtime.gcDrain(0xa0001000003be98, 0x3)
	/ramdisk8GB/workdir-host-aix-ppc64-osuosl/go1.4/src/runtime/mgcmark.go:1047 +0x25c fp=0x11027d6b0 sp=0x11027d648 pc=0x10002031c
runtime.gcBgMarkWorker.func2()
	/ramdisk8GB/workdir-host-aix-ppc64-osuosl/go1.4/src/runtime/mgc.go:1269 +0xbc fp=0x11027d720 sp=0x11027d6b0 pc=0x10001ca2c
runtime.systemstack()
	/ramdisk8GB/workdir-host-aix-ppc64-osuosl/go1.4/src/runtime/asm_ppc64x.s:250 +0x68 fp=0x11027d740 sp=0x11027d720 pc=0x10006c0e8

2022-09-16 16:32 linux-386-buster go@686b38b5 compress/flate (log)

runtime: pointer 0x9ec6000 to unallocated span span.base()=0x9ec6000 span.limit=0x9ed5fff span.state=0
runtime: found in object at *(0xa7a2000+0x3c)
object=0xa7a2000 s.base()=0xa702000 s.limit=0xa7a2484 s.spanclass=0 s.elemsize=663552 s.state=mSpanInUse
 *(object+0) = 0x0
 *(object+4) = 0x0
 *(object+8) = 0x0
 *(object+12) = 0x0
 *(object+16) = 0x0
 *(object+20) = 0x0
 *(object+24) = 0x0
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x8192faf, 0x3e})
	/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x983bec4 sp=0x983beb0 pc=0x807ed6d
runtime.badPointer(0xef819a50, 0x9ec6000, 0xa7a2000, 0x3c)
	/workdir/go/src/runtime/mbitmap.go:314 +0xa2 fp=0x983bee4 sp=0x983bec4 pc=0x8058582
runtime.findObject(0x9ec6000, 0xa7a2000, 0x3c)
	/workdir/go/src/runtime/mbitmap.go:357 +0x9f fp=0x983befc sp=0x983bee4 pc=0x80587df
runtime.scanobject(0xa7a2000, 0x942c95c)
	/workdir/go/src/runtime/mgcmark.go:1335 +0x16e fp=0x983bf4c sp=0x983befc pc=0x8064c8e
runtime.gcDrain(0x942c95c, 0x3)
	/workdir/go/src/runtime/mgcmark.go:1103 +0x24f fp=0x983bfb0 sp=0x983bf4c pc=0x80643ef
runtime.gcBgMarkWorker.func2()
	/workdir/go/src/runtime/mgc.go:1339 +0xaf fp=0x983bfdc sp=0x983bfb0 pc=0x805fcef
runtime.systemstack()
	/workdir/go/src/runtime/asm_386.s:370 +0x41 fp=0x983bfe0 sp=0x983bfdc pc=0x80af361

— watchflakes

gopherbot · 2022-09-21T19:00:43Z

Found new dashboard test flakes for:

#!watchflakes
default <- `runtime.throw\(` || `fatal error:`

2022-08-22 22:29 linux-amd64-staticlockranking go@ae303ff2 cmd/trace.TestFoo (log)

212720  ======
0 : sysmon 1 0xd6c998
1 : traceBuf 23 0xd83f98
2 : traceStackTab 42 0xd73ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7fefe3385c20 sp=0x7fefe3385bf0 pc=0x439e3d
...
	/workdir/go/src/runtime/trace.go:879 +0xc5 fp=0xc000051450 sp=0xc000051408 pc=0x45d825
runtime.StartTrace()
	/workdir/go/src/runtime/trace.go:242 +0xa9 fp=0xc0000514d0 sp=0xc000051450 pc=0x45bc09
runtime/trace.Start({0xb3adc0?, 0xc0000a7560})
	/workdir/go/src/runtime/trace/trace.go:125 +0x97 fp=0xc000051528 sp=0xc0000514d0 pc=0x50bf17
cmd/trace.traceProgram(0xc0002a9380, 0xad1d00, {0x7f636b, 0x7})
	/workdir/go/src/cmd/trace/annotations_test.go:334 +0x5f fp=0xc0000515b0 sp=0xc000051528 pc=0x75031f
cmd/trace.TestFoo(0xc0002a9380)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc000051770 sp=0xc0000515b0 pc=0x752a49
testing.tRunner(0xc0002a9380, 0xad1d08)

2022-08-22 23:16 linux-amd64-staticlockranking go@cd528184 cmd/trace.TestFoo (log)

212262  ======
0 : sysmon 1 0xd6b998
1 : traceBuf 23 0xd82f98
2 : traceStackTab 42 0xd72ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f91427fbc20 sp=0x7f91427fbbf0 pc=0x439e3d
...
	/workdir/go/src/runtime/trace.go:879 +0xc5 fp=0xc0000d1c50 sp=0xc0000d1c08 pc=0x45d825
runtime.StartTrace()
	/workdir/go/src/runtime/trace.go:242 +0xa9 fp=0xc0000d1cd0 sp=0xc0000d1c50 pc=0x45bc09
runtime/trace.Start({0xb3ada0?, 0xc0002a6660})
	/workdir/go/src/runtime/trace/trace.go:125 +0x97 fp=0xc0000d1d28 sp=0xc0000d1cd0 pc=0x50bf17
cmd/trace.traceProgram(0xc00022a820, 0xad1d00, {0x7f636b, 0x7})
	/workdir/go/src/cmd/trace/annotations_test.go:334 +0x5f fp=0xc0000d1db0 sp=0xc0000d1d28 pc=0x75031f
cmd/trace.TestFoo(0xc00022a820)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc0000d1f70 sp=0xc0000d1db0 pc=0x752a49
testing.tRunner(0xc00022a820, 0xad1d08)

2022-08-22 23:36 linux-amd64-staticlockranking go@e0388c92 cmd/trace.TestFoo (log)

210167  ======
0 : sysmon 1 0xd6b998
1 : traceBuf 23 0xd82f98
2 : traceStackTab 42 0xd72ef8
3 : gscan 34 0x0
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x7ff8b0?, 0x45d7e5?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f93d994cc20 sp=0x7f93d994cbf0 pc=0x439e3d
...
	/workdir/go/src/runtime/trace.go:879 +0xc5 fp=0xc00023e450 sp=0xc00023e408 pc=0x45d825
runtime.StartTrace()
	/workdir/go/src/runtime/trace.go:242 +0xa9 fp=0xc00023e4d0 sp=0xc00023e450 pc=0x45bc09
runtime/trace.Start({0xb3ada0?, 0xc000205d70})
	/workdir/go/src/runtime/trace/trace.go:125 +0x97 fp=0xc00023e528 sp=0xc00023e4d0 pc=0x50bf17
cmd/trace.traceProgram(0xc0000d24e0, 0xad1d00, {0x7f636b, 0x7})
	/workdir/go/src/cmd/trace/annotations_test.go:334 +0x5f fp=0xc00023e5b0 sp=0xc00023e528 pc=0x75031f
cmd/trace.TestFoo(0xc0000d24e0)
	/workdir/go/src/cmd/trace/trace_test.go:190 +0x49 fp=0xc00023e770 sp=0xc00023e5b0 pc=0x752a49
testing.tRunner(0xc0000d24e0, 0xad1d08)

2022-08-26 15:44 linux-mips-rtrk net@83b083e8 go@bd5595d7 (log)

fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x31c80]

runtime stack:
runtime.throw({0x1a26ae, 0x2a})
	/tmp/gobuilder-mips64/go1.4/src/runtime/panic.go:1198 +0x6c
runtime.sigpanic()
	/tmp/gobuilder-mips64/go1.4/src/runtime/signal_unix.go:719 +0x328
runtime.readgstatus(...)
	/tmp/gobuilder-mips64/go1.4/src/runtime/proc.go:889
runtime.markroot(0xc000028e98, 0x96)
	/tmp/gobuilder-mips64/go1.4/src/runtime/mgcmark.go:198 +0x228
runtime.gcDrain(0xc000028e98, 0x3)
	/tmp/gobuilder-mips64/go1.4/src/runtime/mgcmark.go:1013 +0x534
runtime.gcBgMarkWorker.func2()
	/tmp/gobuilder-mips64/go1.4/src/runtime/mgc.go:1269 +0xe4
runtime.systemstack()
	/tmp/gobuilder-mips64/go1.4/src/runtime/asm_mips64x.s:191 +0x7c

— watchflakes

rsc · 2022-09-28T19:33:19Z

These are old failures. The goal for this bug is to be reopened each time there's a new otherwise uncategorized runtime.throw (instead of, say, creating a new bug pointing at a test in package strings or wherever it manifested), and then we make a more specific issue for it, and close this one. And then the next time there's an uncategorized runtime.throw, watchflakes posts and reopens. So I will close this one right now.

gopherbot · 2022-10-04T18:44:02Z

Found new dashboard test flakes for:

#!watchflakes
default <- `runtime.throw\(` || `fatal error:`

2022-09-29 19:35 linux-386-softfloat go@545adcfe compress/flate.TestDeflateInflate (log)

runtime: pointer 0x91e8000 to unallocated span span.base()=0x91e8000 span.limit=0x91f7fff span.state=0
runtime: found in object at *(0x9fb8000+0x3c)
object=0x9fb8000 s.base()=0x9f18000 s.limit=0x9fb8484 s.spanclass=0 s.elemsize=663552 s.state=mSpanInUse
 *(object+0) = 0x0
 *(object+4) = 0x0
 *(object+8) = 0x0
 *(object+12) = 0x0
 *(object+16) = 0x0
 *(object+20) = 0x0
 *(object+24) = 0x0
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x819834d, 0x3e})
	/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x8d89ec4 sp=0x8d89eb0 pc=0x807fd3d
runtime.badPointer(0xef54ea20, 0x91e8000, 0x9fb8000, 0x3c)
	/workdir/go/src/runtime/mbitmap.go:314 +0xa2 fp=0x8d89ee4 sp=0x8d89ec4 pc=0x80589a2
runtime.findObject(0x91e8000, 0x9fb8000, 0x3c)
	/workdir/go/src/runtime/mbitmap.go:357 +0x9f fp=0x8d89efc sp=0x8d89ee4 pc=0x8058bff
runtime.scanobject(0x9fb8000, 0x8828f5c)
...
	/workdir/go/src/compress/flate/deflate.go:666 +0x23 fp=0x89fad30 sp=0x89fad10 pc=0x8136703
compress/flate.testSync(0x8882e10, 0x6, {0x8269086, 0x1, 0x1}, {0x88b8078, 0x2})
	/workdir/go/src/compress/flate/deflate_test.go:265 +0x417 fp=0x89faea0 sp=0x89fad30 pc=0x813e897
compress/flate.testToFromWithLevelAndLimit(0x8882e10, 0x6, {0x8269086, 0x1, 0x1}, {0x88b8078, 0x2}, 0x0)
	/workdir/go/src/compress/flate/deflate_test.go:369 +0x4bc fp=0x89faf14 sp=0x89faea0 pc=0x813faec
compress/flate.testToFromWithLimit(0x8882e10, {0x8269086, 0x1, 0x1}, {0x88b8078, 0x2}, {0x0, 0x0, 0x0, 0x0, ...})
	/workdir/go/src/compress/flate/deflate_test.go:374 +0x65 fp=0x89faf3c sp=0x89faf14 pc=0x813fb65
compress/flate.TestDeflateInflate(0x8882e10)
	/workdir/go/src/compress/flate/deflate_test.go:386 +0x11d fp=0x89faf9c sp=0x89faf3c pc=0x813fd0d
testing.tRunner(0x8882e10, 0x819ab88)

— watchflakes

cherrymui · 2022-10-04T18:58:58Z

This is #54596 . I updated pattern there.

For this issue, does watchflakes suppose to reopen it as it found a new failure? @rsc

gopherbot · 2022-10-13T12:46:11Z

Found new dashboard test flakes for:

#!watchflakes
default <- `runtime.throw\(` || `fatal error:`

2022-10-05 00:48 illumos-amd64 go@d1187438 runtime/trace.TestTraceFutileWakeup (log)

fatal error: runtime·lock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
fatal error: runtime·unlock: lock count
...
	/var/tmp/workdir-host-illumos-amd64-jclulow/go/src/internal/trace/parser.go:233 +0x1209 fp=0xc00004cb20 sp=0xc00004c8d8 pc=0x51d069
internal/trace.parse({0x5e6720?, 0xc00007c7e0?}, {0x0, 0x0})
	/var/tmp/workdir-host-illumos-amd64-jclulow/go/src/internal/trace/parser.go:104 +0x37 fp=0xc00004cb90 sp=0xc00004cb20 pc=0x51bc77
internal/trace.Parse({0x5e6720?, 0xc00007c7e0?}, {0x0?, 0x0})
	/var/tmp/workdir-host-illumos-amd64-jclulow/go/src/internal/trace/parser.go:91 +0x31 fp=0xc00004cbc8 sp=0xc00004cb90 pc=0x51bb71
runtime/trace_test.parseTrace(0xc00023aea0, {0x5e6720?, 0xc00007c7e0?})
	/var/tmp/workdir-host-illumos-amd64-jclulow/go/src/runtime/trace/trace_test.go:146 +0x50 fp=0xc00004cdc0 sp=0xc00004cbc8 pc=0x5627f0
runtime/trace_test.TestTraceFutileWakeup(0xc00023aea0)
	/var/tmp/workdir-host-illumos-amd64-jclulow/go/src/runtime/trace/trace_test.go:560 +0x3db fp=0xc00004cf70 sp=0xc00004cdc0 pc=0x564e7b
testing.tRunner(0xc00023aea0, 0x5c2540)

— watchflakes

gopherbot · 2022-10-19T22:11:20Z

Found new dashboard test flakes for:

#!watchflakes
default <- `runtime.throw\(` || `fatal error:`

2022-10-14 17:33 windows-amd64-race text@1bdb400f go@bfcc3a75 x/text/internal/gen/bitfield (log)

unexpected fault address 0x6384f3
fatal error: fault
[signal 0xc0000005 code=0x1 addr=0x6384f3 pc=0x450e27]

— watchflakes

gopherbot · 2022-11-04T17:59:48Z

Found new dashboard test flakes for:

#!watchflakes
default <- `runtime.throw\(` || `fatal error:`

2022-11-03 17:41 linux-amd64-staticlockranking go@5c0d314a os/signal.TestSignalTrace (log)

99928  ======
0 : trace 42 0x657b20
1 : wbufSpans 39 0x651030
fatal error: lock ordering problem

runtime stack:
runtime.throw({0x553dbd?, 0x0?})
	/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f153fffeb58 sp=0x7f153fffeb28 pc=0x4392fd
runtime.checkRanks(0xc0001021a0, 0xc000067000?, 0x4cb503?)
	/workdir/go/src/runtime/lockrank_on.go:156 +0x22d fp=0x7f153fffebb8 sp=0x7f153fffeb58 pc=0x40de8d
...
	/workdir/go/src/runtime/sema.go:160 +0x214 fp=0xc0000afe48 sp=0xc0000afde0 pc=0x44d6f4
runtime.semacquire(...)
	/workdir/go/src/runtime/sema.go:111
runtime.StopTrace()
	/workdir/go/src/runtime/trace.go:395 +0x285 fp=0xc0000afe80 sp=0xc0000afe48 pc=0x45bf65
runtime/trace.Stop()
	/workdir/go/src/runtime/trace/trace.go:148 +0x8e fp=0xc0000afeb8 sp=0xc0000afe80 pc=0x4bec6e
os/signal.TestSignalTrace(0xc000007d40)
	/workdir/go/src/os/signal/signal_test.go:908 +0x21a fp=0xc0000aff70 sp=0xc0000afeb8 pc=0x4e3f9a
testing.tRunner(0xc000007d40, 0x55cc18)

— watchflakes

aclements · 2022-11-08T15:26:27Z

2022-11-03 17:41 linux-amd64-staticlockranking go@5c0d314a os/signal.TestSignalTrace (log)

This is #56554. I've added a pattern to that issue.

gopherbot · 2022-11-17T16:07:09Z

Found new dashboard test flakes for:

#!watchflakes
default <- `runtime.throw\(` || `fatal error:`

2022-09-29 20:41 windows-386-2008 sync@8fcdb60f go@b7662047 x/sync/errgroup_test [build] (log)

fatal error: unknown runnable goroutine during bootstrap

runtime stack:
runtime.throw({0x6e8761, 0x2b})
	C:/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x18fed0 sp=0x18febc pc=0x43626d
runtime.schedinit()
	C:/workdir/go/src/runtime/proc.go:738 +0x2ea fp=0x18ff00 sp=0x18fed0 pc=0x43a0aa
runtime.rt0_go()
	C:/workdir/go/src/runtime/asm_386.s:239 +0x15f fp=0x18ff04 sp=0x18ff00 pc=0x461d9f

2022-09-29 20:41 windows-386-2008 sync@8fcdb60f go@b7662047 x/sync/errgroup.test [build] (log)

unexpected fault address 0x80000007
fatal error: fault
[signal 0xc0000005 code=0x0 addr=0x80000007 pc=0x40ef4f]

goroutine 1 [running]:
runtime.throw({0x685b3b, 0x5})
	C:/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0xaca72e4 sp=0xaca72d0 pc=0x43928d
runtime.sigpanic()
	C:/workdir/go/src/runtime/signal_windows.go:270 +0x105 fp=0xaca7308 sp=0xaca72e4 pc=0x44ed35
runtime.mapaccess2_fast32(0x657940, 0xaca74ac, 0xd233)
	C:/workdir/go/src/runtime/map_fast32.go:85 +0x11f fp=0xaca7318 sp=0xaca7308 pc=0x40ef4f
cmd/link/internal/ld.(*stackCheck).check(0xaca7478, 0xd233)
	C:/workdir/go/src/cmd/link/internal/ld/stackcheck.go:145 +0x3a fp=0xaca7378 sp=0xaca7318 pc=0x5d055a
cmd/link/internal/ld.(*Link).doStackCheck(0xad0c000)
	C:/workdir/go/src/cmd/link/internal/ld/stackcheck.go:79 +0x1db fp=0xaca74cc sp=0xaca7378 pc=0x5d00cb
cmd/link/internal/ld.Main(0x8479e0, {0x10, 0x20, 0x1, 0x4, 0x8, 0x0, {0x0, 0x0}, {0x68d080, ...}, ...})
	C:/workdir/go/src/cmd/link/internal/ld/main.go:288 +0x12b8 fp=0xaca761c sp=0xaca74cc pc=0x5c18e8
main.main()
	C:/workdir/go/src/cmd/link/main.go:72 +0xa73 fp=0xaca7fc4 sp=0xaca761c pc=0x638563
runtime.main()
	C:/workdir/go/src/runtime/proc.go:250 +0x22e fp=0xaca7ff0 sp=0xaca7fc4 pc=0x43be5e
runtime.goexit()
	C:/workdir/go/src/runtime/asm_386.s:1326 +0x1 fp=0xaca7ff4 sp=0xaca7ff0 pc=0x468311

2022-11-16 21:35 ios-arm64-corellium go@c3a0854e cmd/internal/archive.test [build] (log)

runtime: pointer 0x1068293a0 to unused region of span span.base()=0x106818000 span.limit=0x106828950 span.state=1
runtime: found in object at *(0x1313a0000+0x3920)
object=0x1313a0000 s.base()=0x1313a0000 s.limit=0x1313bb580 s.spanclass=0 s.elemsize=114688 s.state=mSpanInUse
 *(object+0) = 0x1065396f4
 *(object+8) = 0x1a
 *(object+16) = 0x0
 *(object+24) = 0x0
 *(object+32) = 0x0
 *(object+40) = 0x0
 *(object+48) = 0x0
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x10262a73f?, 0x6?})
	/tmp/workdir-host-ios-arm64-corellium-ios/go/src/runtime/panic.go:1047 +0x40 fp=0x16d9eac60 sp=0x16d9eac30 pc=0x10244cb00
runtime.badPointer(0x106637a18, 0x130033238?, 0x1313a0000, 0x102436c68?)
	/tmp/workdir-host-ios-arm64-corellium-ios/go/src/runtime/mbitmap.go:314 +0x120 fp=0x16d9eacb0 sp=0x16d9eac60 pc=0x10242c230
runtime.findObject(0x106818000?, 0x10245bf9c?, 0x16d9ead28?)
	/tmp/workdir-host-ios-arm64-corellium-ios/go/src/runtime/mbitmap.go:357 +0xb8 fp=0x16d9eacf0 sp=0x16d9eacb0 pc=0x10242c398
runtime.scanobject(0x1313a0000, 0x130033238)
	/tmp/workdir-host-ios-arm64-corellium-ios/go/src/runtime/mgcmark.go:1335 +0x138 fp=0x16d9ead80 sp=0x16d9eacf0 pc=0x102436cb8
runtime.gcDrain(0x130033238, 0x7)
	/tmp/workdir-host-ios-arm64-corellium-ios/go/src/runtime/mgcmark.go:1103 +0x1b4 fp=0x16d9eade0 sp=0x16d9ead80 pc=0x1024364e4
runtime.gcBgMarkWorker.func2()
	/tmp/workdir-host-ios-arm64-corellium-ios/go/src/runtime/mgc.go:1367 +0x74 fp=0x16d9eae30 sp=0x16d9eade0 pc=0x1024329d4
runtime.systemstack()
	/tmp/workdir-host-ios-arm64-corellium-ios/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x16d9eae40 sp=0x16d9eae30 pc=0x10247b31c

— watchflakes

gopherbot · 2022-11-21T17:14:25Z

Found new dashboard test flakes for:

#!watchflakes
default <- `runtime.throw\(` || `fatal error:`

2022-11-18 18:55 netbsd-arm64-bsiegert website@5934f13c go@bda02354 x/website/internal/dl.test [build] (log)

unexpected fault address 0xffffcabbb5d0
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0xffffcabbb5d0 pc=0x73088]

goroutine 87 [running]:
runtime.throw({0x26e5f2?, 0x10724c?})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:1047 +0x40 fp=0x40048cecd0 sp=0x40048ceca0 pc=0x42c90
runtime.sigpanic()
	/var/gobuilder/buildlet/go/src/runtime/signal_unix.go:851 +0x1a8 fp=0x40048ced10 sp=0x40048cecd0 pc=0x598e8
runtime.memmove()
	/var/gobuilder/buildlet/go/src/runtime/memmove_arm64.s:96 +0xb8 fp=0x40048ced20 sp=0x40048ced20 pc=0x73088
cmd/link/internal/loader.(*SymbolBuilder).SetBytesAt(...)
	/var/gobuilder/buildlet/go/src/cmd/link/internal/loader/symbolbuilder.go:350
cmd/link/internal/ld.(*pclntab).generatePctab.func2(0x2332e0?, 0x400006c810?)
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/pcln.go:519 +0x108 fp=0x40048cedd0 sp=0x40048ced20 pc=0x1a4a88
cmd/link/internal/ld.writeBlock(0x400013e000, 0x0?, 0x40006c0000, {0x40019f8420, 0x1054, 0x0?}, 0x0?, 0x0?, {0x471f80, 0x200, ...})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:1005 +0x300 fp=0x40048ceef0 sp=0x40048cedd0 pc=0x153d20
cmd/link/internal/ld.writeBlocks.func1(0x0?, 0x0?, {0x40019f8420?, 0x0?, 0x0?}, 0x0?, 0x0?, {0x471f80?, 0x0?, 0x0?})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:959 +0x64 fp=0x40048cef70 sp=0x40048ceef0 pc=0x153994
cmd/link/internal/ld.writeBlocks.func2()
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:962 +0x54 fp=0x40048cefd0 sp=0x40048cef70 pc=0x1538f4
runtime.goexit()
	/var/gobuilder/buildlet/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x40048cefd0 sp=0x40048cefd0 pc=0x72714
created by cmd/link/internal/ld.writeBlocks
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:958 +0x4dc

2022-11-18 18:55 netbsd-arm64-bsiegert website@5934f13c go@bda02354 x/website/internal/pkgdoc.test [build] (log)

unexpected fault address 0xffffcdb70000
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0xffffcdb70000 pc=0x73168]

goroutine 50 [running]:
runtime.throw({0x26e5f2?, 0x10724c?})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:1047 +0x40 fp=0x400162ed00 sp=0x400162ecd0 pc=0x42c90
runtime.sigpanic()
	/var/gobuilder/buildlet/go/src/runtime/signal_unix.go:851 +0x1a8 fp=0x400162ed40 sp=0x400162ed00 pc=0x598e8
runtime.memmove()
	/var/gobuilder/buildlet/go/src/runtime/memmove_arm64.s:175 +0x198 fp=0x400162ed50 sp=0x400162ed50 pc=0x73168
cmd/link/internal/ld.(*OutBuf).WriteSym(0x400053e000, 0x4000586000, 0x1b2b9?)
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/outbuf.go:314 +0x160 fp=0x400162edd0 sp=0x400162ed50 pc=0x1a1b10
cmd/link/internal/ld.writeBlock(0x400013e000, 0x0?, 0x4000586000, {0x400189b8e8, 0xf4c, 0x0?}, 0x0?, 0x15c770?, {0x471f80, 0x200, ...})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:1002 +0x2b4 fp=0x400162eef0 sp=0x400162edd0 pc=0x153cd4
cmd/link/internal/ld.writeBlocks.func1(0x0?, 0x400013e000?, {0x400189b8e8?, 0x4001120ce0?, 0x2?}, 0x2?, 0x27?, {0x471f80?, 0x4001120de0?, 0x4000b74f00?})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:959 +0x64 fp=0x400162ef70 sp=0x400162eef0 pc=0x153994
cmd/link/internal/ld.writeBlocks.func2()
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:962 +0x54 fp=0x400162efd0 sp=0x400162ef70 pc=0x1538f4
runtime.goexit()
	/var/gobuilder/buildlet/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x400162efd0 sp=0x400162efd0 pc=0x72714
created by cmd/link/internal/ld.writeBlocks
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:958 +0x4dc

2022-11-18 18:55 netbsd-arm64-bsiegert website@5934f13c go@bda02354 x/website/internal/tour.test [build] (log)

unexpected fault address 0xffffc535eb86
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0xffffc535eb86 pc=0x73038]

goroutine 68 [running]:
runtime.throw({0x26e5f2?, 0x10724c?})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:1047 +0x40 fp=0x4000d5fcd0 sp=0x4000d5fca0 pc=0x42c90
runtime.sigpanic()
	/var/gobuilder/buildlet/go/src/runtime/signal_unix.go:851 +0x1a8 fp=0x4000d5fd10 sp=0x4000d5fcd0 pc=0x598e8
runtime.memmove()
	/var/gobuilder/buildlet/go/src/runtime/memmove_arm64.s:67 +0x68 fp=0x4000d5fd20 sp=0x4000d5fd20 pc=0x73038
cmd/link/internal/loader.(*SymbolBuilder).SetBytesAt(...)
	/var/gobuilder/buildlet/go/src/cmd/link/internal/loader/symbolbuilder.go:350
cmd/link/internal/ld.(*pclntab).generatePctab.func2(0x2332e0?, 0x400006c810?)
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/pcln.go:519 +0x108 fp=0x4000d5fdd0 sp=0x4000d5fd20 pc=0x1a4a88
cmd/link/internal/ld.writeBlock(0x400013e000, 0x4000d72070?, 0x4000174000, {0x40021d5668, 0xb4a, 0x400013ac40?}, 0x400012e0a0?, 0x4000174000?, {0x471f80, 0x200, ...})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:1005 +0x300 fp=0x4000d5fef0 sp=0x4000d5fdd0 pc=0x153d20
cmd/link/internal/ld.writeBlocks.func1(0x0?, 0x72714?, {0x40021d5668?, 0x72718?, 0x23d72?}, 0x23d73?, 0x23d74?, {0x471f80?, 0x4000d3c270?, 0x40018e27b0?})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:959 +0x64 fp=0x4000d5ff70 sp=0x4000d5fef0 pc=0x153994
cmd/link/internal/ld.writeBlocks.func2()
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:962 +0x54 fp=0x4000d5ffd0 sp=0x4000d5ff70 pc=0x1538f4
runtime.goexit()
	/var/gobuilder/buildlet/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x4000d5ffd0 sp=0x4000d5ffd0 pc=0x72714
created by cmd/link/internal/ld.writeBlocks
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:958 +0x4dc

2022-11-18 18:55 netbsd-arm64-bsiegert website@5934f13c go@bda02354 x/website/internal/web.test [build] (log)

unexpected fault address 0xffffcd7dc000
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0xffffcd7dc000 pc=0x73160]

goroutine 84 [running]:
runtime.throw({0x26e5f2?, 0x10724c?})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:1047 +0x40 fp=0x400187ed00 sp=0x400187ecd0 pc=0x42c90
runtime.sigpanic()
	/var/gobuilder/buildlet/go/src/runtime/signal_unix.go:851 +0x1a8 fp=0x400187ed40 sp=0x400187ed00 pc=0x598e8
runtime.memmove()
	/var/gobuilder/buildlet/go/src/runtime/memmove_arm64.s:173 +0x190 fp=0x400187ed50 sp=0x400187ed50 pc=0x73160
cmd/link/internal/ld.(*OutBuf).WriteSym(0x40013661c0, 0x400009c000, 0x196e6?)
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/outbuf.go:314 +0x160 fp=0x400187edd0 sp=0x400187ed50 pc=0x1a1b10
cmd/link/internal/ld.writeBlock(0x400013e000, 0x0?, 0x400009c000, {0x4001862878, 0x7ba, 0x0?}, 0x0?, 0x15c770?, {0x471f80, 0x200, ...})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:1002 +0x2b4 fp=0x400187eef0 sp=0x400187edd0 pc=0x153cd4
cmd/link/internal/ld.writeBlocks.func1(0x0?, 0x400013e000?, {0x4001862878?, 0x40008a9000?, 0x543?}, 0x700?, 0x9?, {0x471f80?, 0x4000ab59e0?, 0x4000166500?})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:959 +0x64 fp=0x400187ef70 sp=0x400187eef0 pc=0x153994
cmd/link/internal/ld.writeBlocks.func2()
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:962 +0x54 fp=0x400187efd0 sp=0x400187ef70 pc=0x1538f4
runtime.goexit()
	/var/gobuilder/buildlet/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x400187efd0 sp=0x400187efd0 pc=0x72714
created by cmd/link/internal/ld.writeBlocks
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:958 +0x4dc

2022-11-18 18:55 netbsd-arm64-bsiegert website@5934f13c go@e84ce080 x/website/cmd/golangorg.test [build] (log)

unexpected fault address 0xffffbcce7000
fatal error: fault
unexpected fault address 0xffffbcbff000
fatal error: fault
unexpected fault address 0xffffbc99b000
fatal error: fault
unexpected fault address 0xffffbcb17000
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0xffffbcce7000 pc=0x73168]

...
cmd/link/internal/ld.writeBlock(0x400013e000, 0x0?, 0x4000192000, {0x4002879a18, 0x78a6, 0x0?}, 0x0?, 0x15c530?, {0x471f80, 0x200, ...})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:1002 +0x2b4 fp=0x4000098ef0 sp=0x4000098dd0 pc=0x153a94
cmd/link/internal/ld.writeBlocks.func1(0x0?, 0x400013e000?, {0x4002879a18?, 0x72718?, 0x1?}, 0x1?, 0x15?, {0x471f80?, 0x40019b7880?, 0x4000b5aa00?})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:959 +0x64 fp=0x4000098f70 sp=0x4000098ef0 pc=0x153754
cmd/link/internal/ld.writeBlocks.func2()
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:962 +0x54 fp=0x4000098fd0 sp=0x4000098f70 pc=0x1536b4
runtime.goexit()
	/var/gobuilder/buildlet/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x4000098fd0 sp=0x4000098fd0 pc=0x72714
created by cmd/link/internal/ld.writeBlocks
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:958 +0x4dc

2022-11-18 18:55 netbsd-arm64-bsiegert website@5934f13c go@f4f8397f x/website/cmd/golangorg.test [build] (log)

unexpected fault address 0xffffbc9bf000
fatal error: fault
unexpected fault address 0xffffbc877000
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0xffffbc9bf000 pc=0x73168]

goroutine 141 [running]:
runtime.throw({0x26e5f2?, 0x10724c?})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:1047 +0x40 fp=0x4000037d00 sp=0x4000037cd0 pc=0x42c90
runtime.sigpanic()
...
cmd/link/internal/ld.writeBlock(0x400013e000, 0x0?, 0x4000586000, {0x400279b9f0, 0x78ab, 0x0?}, 0x0?, 0x15c530?, {0x471f80, 0x200, ...})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:1002 +0x2b4 fp=0x40000c4ef0 sp=0x40000c4dd0 pc=0x153a94
cmd/link/internal/ld.writeBlocks.func1(0x0?, 0x400013e000?, {0x400279b9f0?, 0x40019457d0?, 0x2?}, 0x2?, 0x19?, {0x471f80?, 0x4001945880?, 0x40009ef900?})
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:959 +0x64 fp=0x40000c4f70 sp=0x40000c4ef0 pc=0x153754
cmd/link/internal/ld.writeBlocks.func2()
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:962 +0x54 fp=0x40000c4fd0 sp=0x40000c4f70 pc=0x1536b4
runtime.goexit()
	/var/gobuilder/buildlet/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x40000c4fd0 sp=0x40000c4fd0 pc=0x72714
created by cmd/link/internal/ld.writeBlocks
	/var/gobuilder/buildlet/go/src/cmd/link/internal/ld/data.go:958 +0x4dc

— watchflakes

gopherbot · 2022-11-28T18:11:02Z

Found new dashboard test flakes for:

#!watchflakes
default <- `runtime.throw\(` || `fatal error:`

2022-11-23 19:34 linux-mips64le-rtrk go@a8510f92 runtime.TestRecoverBeforePanicAfterGoexit2 (log)

--- FAIL: TestRecoverBeforePanicAfterGoexit2 (69.55s)
    crash_test.go:58: /tmp/gobuilder-mips64le/tmp/go-build3305139991/testprog.exe RecoverBeforePanicAfterGoexit2: exit status 2
    crash_test.go:468: output does not start with "fatal error: no goroutines (main called runtime.Goexit) - deadlock!":

— watchflakes

bcmills · 2022-11-28T20:35:11Z

That last one looks like a false-positive for this issue — maybe we need to update the regexp to only match fatal error: at the start of a line?

cherrymui · 2022-11-28T20:50:02Z

maybe we need to update the regexp to only match fatal error: at the start of a line?

Makes sense. Done. Thanks.

gopherbot · 2022-12-08T12:17:40Z

Found new dashboard test flakes for:

#!watchflakes
default <- (`runtime.throw\(` || `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm"

2022-12-08 03:49 linux-s390x-ibm go@b9747e0e os/user.TestLookupGroup (log)

runtime: bad pointer in frame os/user.lookupUnixGid at 0xc000104e00: 0x78
fatal error: invalid pointer found on stack

runtime stack:
runtime.throw({0x1767a6, 0x1e})
	/data/golang/workdir/go/src/runtime/panic.go:1047 +0x58 fp=0x3ffcf4fedf0 sp=0x3ffcf4fedc8 pc=0x50538
runtime.adjustpointers(0xc000104de8, 0x3ffcf4feee0, 0x3ffcf4ff2c0, {0x235b28, 0x2476e0})
	/data/golang/workdir/go/src/runtime/stack.go:632 +0x2b0 fp=0x3ffcf4fee50 sp=0x3ffcf4fedf0 pc=0x6cf00
runtime.adjustframe(0x3ffcf4ff1e8, 0x3ffcf4ff2c0)
	/data/golang/workdir/go/src/runtime/stack.go:674 +0x10e fp=0x3ffcf4fef00 sp=0x3ffcf4fee50 pc=0x6d01e
...
	/data/golang/workdir/go/src/os/user/cgo_lookup_unix.go:184 +0x66 fp=0xc000104da0 sp=0xc000104d40 pc=0x130866
os/user.lookupUnixGid(0x0)
	/data/golang/workdir/go/src/os/user/cgo_lookup_unix.go:120 +0x8c fp=0xc000104e58 sp=0xc000104da0 pc=0x13042c
os/user.lookupGroupId({0x177dee, 0x1})
	/data/golang/workdir/go/src/os/user/cgo_lookup_unix.go:113 +0x78 fp=0xc000104e88 sp=0xc000104e58 pc=0x130368
os/user.LookupGroupId(...)
	/data/golang/workdir/go/src/os/user/lookup.go:64
os/user.TestLookupGroup(0xc000083520)
	/data/golang/workdir/go/src/os/user/user_test.go:110 +0x120 fp=0xc000104f68 sp=0xc000104e88 pc=0x131e00
testing.tRunner(0xc000083520, 0x17be40)

— watchflakes

gopherbot · 2024-04-23T20:46:08Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-04-23 15:10 x_tools-gotip-wasip1-wasm_wasmtime tools@a363d11f go@a62c290c golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	63.975s

— watchflakes

gopherbot · 2024-04-25T08:44:15Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-04-23 20:28 x_tools-gotip-wasip1-wasm_wasmtime tools@15234410 go@db5f2b41 golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	65.190s

2024-04-23 20:28 x_tools-gotip-wasip1-wasm_wasmtime tools@15234410 go@db5f2b41 x/tools/go/ssa.TestTypeparamTest/ifaceconv.go [ABORT] (log)

=== RUN   TestTypeparamTest/ifaceconv.go
    builder_test.go:803: Input: /home/swarming/.swarming/w/ir/x/w/goroot/test/typeparam/ifaceconv.go
runtime: marked free object in span 0x1c94580, elemsize=288 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
0x10880000 free  marked   zombie
0x0000000010880000:  0x00000000000000d5  0x00000000004b5620 
0x0000000010880010:  0x0000000000000001  0x0000000000000000 
0x0000000010880020:  0x0000000000000000  0x0000000000000000 
0x0000000010880030:  0x0000000000000000  0x0000000000000000 
0x0000000010880040:  0x0000000000000000  0x0000000000000000 
0x0000000010880050:  0x0000000000000000  0x0000000000000000 
...
fatal error: found pointer to free object

goroutine 733 gp=0x1801180 m=0 mp=0x4cdf40 [running]:
runtime.throw({0xb6cb1, 0x1c})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1021 +0x3 fp=0x182cfa0 sp=0x182cf78 pc=0x12620003
runtime.(*mspan).reportZombies(0x1c94580)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgcsweep.go:884 +0x61 fp=0x182d010 sp=0x182cfa0 pc=0x118d0061
runtime.(*sweepLocked).sweep(0x182d188, 0x1)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgcsweep.go:650 +0x82 fp=0x182d130 sp=0x182d010 pc=0x11880082
runtime.(*mcentral).cacheSpan(0x4d9118)
...
runtime.gopark(0xcdcb0, 0x1897ee0, 0x1a, 0xa, 0x0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/proc.go:401 +0x22 fp=0x1848738 sp=0x1848710 pc=0x128a0022
runtime.gcBgMarkWorker(0x1b864d0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1352 +0x1f fp=0x18487d0 sp=0x1848738 pc=0x111c001f
runtime.gcBgMarkStartWorkers.gowrap1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1268 +0x2 fp=0x18487e0 sp=0x18487d0 pc=0x111b0002
runtime.goexit({})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_wasm.s:434 +0x1 fp=0x18487e8 sp=0x18487e0 pc=0x151f0001
created by runtime.gcBgMarkStartWorkers in goroutine 42
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1268 +0x28

— watchflakes

gopherbot · 2024-04-27T17:51:59Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-04-26 18:18 x_tools-go1.21-wasip1-wasm_wazero tools@2fa621c3 release-branch.go1.21@891ac91e golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	49.354s

2024-04-26 18:18 x_tools-gotip-wasip1-wasm_wazero tools@2fa621c3 go@b384ee7c golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	52.891s

— watchflakes

gopherbot · 2024-04-29T18:46:41Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-04-29 15:14 x_tools-gotip-wasip1-wasm_wasmtime tools@5ef4fc90 go@16ce8b39 golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	60.897s

— watchflakes

gopherbot · 2024-05-03T23:38:03Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-03 22:19 x_tools-gotip-wasip1-wasm_wasmtime tools@4db16973 go@7994da4c golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	62.993s

2024-05-03 22:19 x_tools-gotip-wasip1-wasm_wasmtime tools@4db16973 go@7994da4c x/tools/go/ssa.TestTypeparamTest/issue47258.go [ABORT] (log)

=== RUN   TestTypeparamTest/issue47258.go
    builder_test.go:803: Input: /home/swarming/.swarming/w/ir/x/w/goroot/test/typeparam/issue47258.go
runtime: marked free object in span 0x1c8f718, elemsize=64 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
0x10870000 free  marked   zombie
0x0000000010870000:  0x0000000000000007  0x0000000000131c00 
0x0000000010870010:  0x000000000e80dd20  0x0000000000130330 
0x0000000010870020:  0x0000000006886c90  0x0000000000000000 
0x0000000010870030:  0x0000000000000000  0x0000000000000000 
0x10870040 free  unmarked
0x10870080 free  unmarked
...
fatal error: found pointer to free object

goroutine 810 gp=0x1bb6700 m=0 mp=0x4cff20 [running]:
runtime.throw({0xb7090, 0x1c})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1021 +0x3 fp=0x188ee28 sp=0x188ee00 pc=0x12610003
runtime.(*mspan).reportZombies(0x1c8f718)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgcsweep.go:884 +0x61 fp=0x188ee98 sp=0x188ee28 pc=0x118c0061
runtime.(*sweepLocked).sweep(0x188f010, 0x1)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgcsweep.go:650 +0x82 fp=0x188efb8 sp=0x188ee98 pc=0x11870082
runtime.(*mcentral).cacheSpan(0x4d9d78)
...
runtime.gopark(0xce088, 0x1897ee0, 0x1a, 0xa, 0x0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/proc.go:401 +0x22 fp=0x1848738 sp=0x1848710 pc=0x12890022
runtime.gcBgMarkWorker(0x1b864d0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1352 +0x1f fp=0x18487d0 sp=0x1848738 pc=0x111b001f
runtime.gcBgMarkStartWorkers.gowrap1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1268 +0x2 fp=0x18487e0 sp=0x18487d0 pc=0x111a0002
runtime.goexit({})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_wasm.s:434 +0x1 fp=0x18487e8 sp=0x18487e0 pc=0x151e0001
created by runtime.gcBgMarkStartWorkers in goroutine 42
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1268 +0x28

— watchflakes

gopherbot · 2024-05-06T18:51:51Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-06 16:54 x_tools-go1.22-wasip1-wasm_wasmtime tools@cc29c91b release-branch.go1.22@93d8777d golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	61.527s

— watchflakes

gopherbot · 2024-05-06T20:51:00Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-06 18:08 x_tools-gotip-wasip1-wasm_wazero tools@b020bdb5 go@5122a679 golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	53.347s

— watchflakes

gopherbot · 2024-05-08T15:57:12Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-08 14:20 x_tools-go1.22-wasip1-wasm_wazero tools@5daf157e release-branch.go1.22@adbfb672 golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	51.192s

— watchflakes

gopherbot · 2024-05-08T17:58:21Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-08 15:39 x_tools-gotip-wasip1-wasm_wasmtime tools@ff28778d go@5be95e09 golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	72.959s

— watchflakes

gopherbot · 2024-05-10T00:09:18Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-09 23:28 gotip-openbsd-amd64 go@23154125 cmd/link.TestExtLinkCmdlineDeterminism (log)

=== RUN   TestExtLinkCmdlineDeterminism
=== PAUSE TestExtLinkCmdlineDeterminism
=== CONT  TestExtLinkCmdlineDeterminism
    link_test.go:1250: output differ:
        host link: "clang" "-m64" "-pthread" "-Wl,-nopie" "-o" a.out "-rdynamic" "-Qunused-arguments" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/go.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000000.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000001.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000002.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000003.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000004.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000005.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000006.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000007.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000008.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000009.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000010.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000011.o" "-O2" "-g" "-O2" "-g" "-lpthread" "-no-pie"
        ==========
        host link: "clang" "-m64" "-pthread" "-Wl,-nopie" "-o" a.out "-Wl,--export-dynamic-symbol=F1" "-Wl,--export-dynamic-symbol=F2" "-Wl,--export-dynamic-symbol=F3" "-Wl,--export-dynamic-symbol=__guard_local" "-Wl,--export-dynamic-symbol=_cgo_panic" "-Wl,--export-dynamic-symbol=_cgo_topofstack" "-Wl,--export-dynamic-symbol=crosscall2" "-Qunused-arguments" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/go.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000000.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000001.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000002.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000003.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000004.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000005.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000006.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000007.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000008.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000009.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000010.o" "/home/swarming/.swarming/w/ir/x/t/TestExtLinkCmdlineDeterminism100608503/001/linktmp/000011.o" "-O2" "-g" "-O2" "-g" "-lpthread" "-no-pie"
--- FAIL: TestExtLinkCmdlineDeterminism (60.89s)

2024-05-09 23:28 gotip-openbsd-amd64 go@23154125 cmd/link/internal/ld.TestDeadcode/ifacemethod3 (log)

=== RUN   TestDeadcode/ifacemethod3
=== PAUSE TestDeadcode/ifacemethod3
=== CONT  TestDeadcode/ifacemethod3
    deadcode_test.go:45: [/home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -ldflags=-dumpdep -o /home/swarming/.swarming/w/ir/x/t/TestDeadcode549798236/001/ifacemethod3.exe testdata/deadcode/ifacemethod3.go]: exit status 1:
        go: error obtaining buildID for go tool asm: fork/exec /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/openbsd_amd64/asm: resource temporarily unavailable
        go: error obtaining buildID for go tool asm: fork/exec /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/openbsd_amd64/asm: resource temporarily unavailable
        go: error obtaining buildID for go tool asm: fork/exec /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/openbsd_amd64/asm: resource temporarily unavailable
--- FAIL: TestDeadcode/ifacemethod3 (2.54s)

2024-05-09 23:28 gotip-openbsd-amd64 go@23154125 cmd/vet.TestVet/httpresponse (log)

=== RUN   TestVet/httpresponse
=== PAUSE TestVet/httpresponse
=== CONT  TestVet/httpresponse
    vet_test.go:211: error check failed: 
        httpresponse.go:22: missing error "using res before checking for errors"
        Unmatched Errors:
        go: error obtaining buildID for go tool asm: fork/exec /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/openbsd_amd64/asm: resource temporarily unavailable
        go: error obtaining buildID for go tool asm: fork/exec /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/openbsd_amd64/asm: resource temporarily unavailable
        go: error obtaining buildID for go tool asm: fork/exec /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/openbsd_amd64/asm: resource temporarily unavailable
        go: error obtaining buildID for go tool asm: fork/exec /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/openbsd_amd64/asm: resource temporarily unavailable
        go: error obtaining buildID for go tool asm: fork/exec /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/openbsd_amd64/asm: resource temporarily unavailable
        fatal error: internal error: exit hook invoked exit
--- FAIL: TestVet/httpresponse (2.01s)

— watchflakes

gopherbot · 2024-05-13T19:14:01Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-13 14:38 darwin-amd64-longtest go@5881ae74 runtime (log)

runtime: checkdead: find g 15319909 in status 1
fatal error: checkdead: runnable g

runtime stack:
runtime.throw({0xef0d730?, 0xc00012c000?})
	/tmp/buildlet/go/src/runtime/panic.go:1027 +0x48 fp=0x70000b332c80 sp=0x70000b332c50 pc=0xeb48768
runtime.checkdead.func1(0xc000281a40)
	/tmp/buildlet/go/src/runtime/proc.go:5818 +0xde fp=0x70000b332cb8 sp=0x70000b332c80 pc=0xeb5859e
runtime.forEachG(0x70000b332d28)
	/tmp/buildlet/go/src/runtime/proc.go:663 +0x58 fp=0x70000b332ce8 sp=0x70000b332cb8 pc=0xeb4ceb8
...
runtime_test.TestCgoPprof(0xc0000f1380?)
	/tmp/buildlet/go/src/runtime/crash_cgo_test.go:358 +0x3d fp=0xc000129f70 sp=0xc000129f18 pc=0xee4895d
testing.tRunner(0xc0000f1380, 0xf07b620)
	/tmp/buildlet/go/src/testing/testing.go:1690 +0xf4 fp=0xc000129fc0 sp=0xc000129f70 pc=0xec211b4
testing.(*T).Run.gowrap1()
	/tmp/buildlet/go/src/testing/testing.go:1743 +0x25 fp=0xc000129fe0 sp=0xc000129fc0 pc=0xec221a5
runtime.goexit({})
	/tmp/buildlet/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000129fe8 sp=0xc000129fe0 pc=0xeb8d161
created by testing.(*T).Run in goroutine 1
	/tmp/buildlet/go/src/testing/testing.go:1743 +0x390

— watchflakes

gopherbot · 2024-05-13T20:32:27Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-13 15:52 gotip-windows-arm64 go@9ea4770e cmd/go.TestScript/goline_order (log)

=== RUN   TestScript/goline_order
=== PAUSE TestScript/goline_order
=== CONT  TestScript/goline_order
    script_test.go:135: 2024-05-13T20:01:28Z
    script_test.go:137: $WORK=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-479500532\tmpdir3640384678\goline_order2254334302
    script_test.go:159: 
        PATH=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-479500532\tmpdir3640384678\testbin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\cache\tools\bin;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3\bin;C:\Users\swarming\.swarming\w\ir\cache\cipd_client;C:\Users\swarming\.swarming\w\ir\cache\cipd_client\bin;C:\Users\swarming\.swarming\cipd_cache\bin;C:\Python311\Scripts\;C:\Python311\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\ProgramData\chocolatey\bin;C:\Users\swarming\AppData\Local\Microsoft\WindowsApps;C:\Users\swarming\.swarming\w\ir\cache\tools\cc\windows\gcc64\bin
        USERPROFILE=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        fatal error: out of memory allocating heap arena map
        
        runtime stack:
        runtime.throw({0x7ff6fab7b78b?, 0x0?})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1027 +0x38 fp=0x14e23ff440 sp=0x14e23ff410 pc=0x7ff6fa41ee08
        runtime.(*mheap).sysAlloc(0x7ff6fb0fd540, 0x101f?, 0x7ff6fb10d980, 0x1)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/malloc.go:757 +0x348 fp=0x14e23ff500 sp=0x14e23ff440 pc=0x7ff6fa3ef7e8
        runtime.(*mheap).grow(0x7ff6fb0fd540, 0x7ff6fa40d6d8?)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mheap.go:1489 +0x84 fp=0x14e23ff580 sp=0x14e23ff500 pc=0x7ff6fa40e544
        runtime.(*mheap).allocSpan(0x7ff6fb0fd540, 0x1, 0x0, 0x26)
...
        internal/cpu.Initialize({0x0, 0x0})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/internal/cpu/cpu.go:129 +0x30 fp=0x14e23ff920 sp=0x14e23ff8f0 pc=0x7ff6fa3e4240
        runtime.cpuinit(...)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/proc.go:694
        runtime.schedinit()
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/proc.go:787 +0xf0 fp=0x14e23ff960 sp=0x14e23ff920 pc=0x7ff6fa423240
        runtime.rt0_go()
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:86 +0xac fp=0x14e23ff990 sp=0x14e23ff960 pc=0x7ff6fa458fcc
    script_test.go:159: FAIL: testdata\script\goline_order.txt:31: go get: exit status 2
--- FAIL: TestScript/goline_order (1.84s)

2024-05-13 15:52 gotip-windows-arm64 go@9ea4770e cmd/go.TestScript/gotoolchain_loop (log)

=== RUN   TestScript/gotoolchain_loop
=== PAUSE TestScript/gotoolchain_loop
=== CONT  TestScript/gotoolchain_loop
    script_test.go:135: 2024-05-13T20:01:26Z
    script_test.go:137: $WORK=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-479500532\tmpdir3640384678\gotoolchain_loop4192933932
    script_test.go:159: 
        PATH=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-479500532\tmpdir3640384678\testbin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\cache\tools\bin;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3\bin;C:\Users\swarming\.swarming\w\ir\cache\cipd_client;C:\Users\swarming\.swarming\w\ir\cache\cipd_client\bin;C:\Users\swarming\.swarming\cipd_cache\bin;C:\Python311\Scripts\;C:\Python311\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\ProgramData\chocolatey\bin;C:\Users\swarming\AppData\Local\Microsoft\WindowsApps;C:\Users\swarming\.swarming\w\ir\cache\tools\cc\windows\gcc64\bin
        USERPROFILE=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        matched: go: toolchain go1.21.1 invoked to provide go1.21.99
        # Toolchain loop should be detected. (3.638s)
        > env TESTGO_VERSION_SWITCH=loop
        > ! go version
        [stderr]
        go: exec C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-479500532\tmpdir3640384678\testbin\go.exe: fork/exec C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-479500532\tmpdir3640384678\testbin\go.exe: The paging file is too small for this operation to complete.
        [exit status 1]
        > stderr -count=10 '^go: switching from go1.21.1 to go1.21.99 \[depth 9[0-9]\]$'
    script_test.go:159: FAIL: testdata\script\gotoolchain_loop.txt:17: stderr -count=10 '^go: switching from go1.21.1 to go1.21.99 \[depth 9[0-9]\]$': found 0 matches for `(?m)^go: switching from go1.21.1 to go1.21.99 \[depth 9[0-9]\]$` in stderr
--- FAIL: TestScript/gotoolchain_loop (3.92s)

2024-05-13 15:54 gotip-windows-arm64 go@f933f78d archive/tar (log)

FAIL	archive/tar [build failed]

2024-05-13 15:54 gotip-windows-arm64 go@f933f78d archive/zip (log)

FAIL	archive/zip [build failed]

2024-05-13 15:54 gotip-windows-arm64 go@f933f78d bufio (log)

FAIL	bufio [build failed]

2024-05-13 16:40 x_telemetry-gotip-windows-arm64 telemetry@80019551 go@9ea4770e golang.org/x/telemetry/godev/cmd/telemetrygodev (log)

FAIL	golang.org/x/telemetry/godev/cmd/telemetrygodev [build failed]

2024-05-13 16:40 x_telemetry-gotip-windows-arm64 telemetry@80019551 go@9ea4770e golang.org/x/telemetry/godev/cmd/worker (log)

FAIL	golang.org/x/telemetry/godev/cmd/worker [build failed]

2024-05-13 16:40 x_telemetry-gotip-windows-arm64 telemetry@80019551 go@9ea4770e golang.org/x/telemetry/godev/internal/content (log)

FAIL	golang.org/x/telemetry/godev/internal/content [build failed]

— watchflakes

gopherbot · 2024-05-14T00:47:24Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-13 18:57 gotip-windows-arm64 go@c98867d2 cmd/go.TestScript/vet_flags (log)

=== RUN   TestScript/vet_flags
=== PAUSE TestScript/vet_flags
=== CONT  TestScript/vet_flags
    script_test.go:135: 2024-05-13T19:44:00Z
    script_test.go:137: $WORK=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-302270168\tmpdir3037659640\vet_flags3150434653
    script_test.go:159: 
        PATH=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-302270168\tmpdir3037659640\testbin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\cache\tools\bin;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3\bin;C:\Users\swarming\.swarming\w\ir\cache\cipd_client;C:\Users\swarming\.swarming\w\ir\cache\cipd_client\bin;C:\Users\swarming\.swarming\cipd_cache\bin;C:\Python311\Scripts\;C:\Python311\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\ProgramData\chocolatey\bin;C:\Users\swarming\AppData\Local\Microsoft\WindowsApps;C:\Users\swarming\.swarming\w\ir\cache\tools\cc\windows\gcc64\bin
        USERPROFILE=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        fatal error: runtime: cannot allocate memory
        
        runtime stack:
        runtime.throw({0x7ff6668fb575?, 0x7ff6665c6678?})
        	runtime/panic.go:1027 +0x38 fp=0x9c8c9ffc40 sp=0x9c8c9ffc10 pc=0x7ff6665b8a38
        runtime.persistentalloc1(0x3ff0, 0x7ff66658bba4?, 0x7ff666be9e80)
        	runtime/malloc.go:1557 +0x284 fp=0x9c8c9ffc90 sp=0x9c8c9ffc40 pc=0x7ff66658e174
        runtime.persistentalloc.func1()
        	runtime/malloc.go:1510 +0x30 fp=0x9c8c9ffcc0 sp=0x9c8c9ffc90 pc=0x7ff66658ded0
        runtime.persistentalloc(0x9c8c9ffd48?, 0x7ff666b9a640?, 0x9c8c9ffd48?)
...
        	runtime/proc.go:401 +0xc8 fp=0x4000053d80 sp=0x4000053d60 pc=0x7ff6665bc318
        runtime.runfinq()
        	runtime/mfinal.go:193 +0x108 fp=0x4000053fd0 sp=0x4000053d80 pc=0x7ff666599408
        runtime.goexit({})
        	runtime/asm_arm64.s:1223 +0x4 fp=0x4000053fd0 sp=0x4000053fd0 pc=0x7ff6665f0544
        created by runtime.createfing in goroutine 1
        	runtime/mfinal.go:163 +0x80
        go: error obtaining buildID for go tool vet: exit status 2
    script_test.go:159: FAIL: testdata\script\vet_flags.txt:16: go vet -n -unsafeptr runtime: exit status 1
--- FAIL: TestScript/vet_flags (5.63s)

2024-05-13 21:10 go1.22-windows-arm64 release-branch.go1.22@d4a81ec7 cmd/go.TestScript/gotoolchain_loop (log)

=== RUN   TestScript/gotoolchain_loop
=== PAUSE TestScript/gotoolchain_loop
=== CONT  TestScript/gotoolchain_loop
    script_test.go:132: 2024-05-13T22:01:36Z
    script_test.go:134: $WORK=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-1912840985\tmpdir1935926708\gotoolchain_loop4141792500
    script_test.go:156: 
        PATH=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-1912840985\tmpdir1935926708\testbin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\cache\tools\bin;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3\bin;C:\Users\swarming\.swarming\w\ir\cache\cipd_client;C:\Users\swarming\.swarming\w\ir\cache\cipd_client\bin;C:\Users\swarming\.swarming\cipd_cache\bin;C:\Python311\Scripts\;C:\Python311\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\ProgramData\chocolatey\bin;C:\Users\swarming\AppData\Local\Microsoft\WindowsApps;C:\Users\swarming\.swarming\w\ir\cache\tools\cc\windows\gcc64\bin
        USERPROFILE=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        matched: go: toolchain go1.21.1 invoked to provide go1.21.99
        # Toolchain loop should be detected. (2.305s)
        > env TESTGO_VERSION_SWITCH=loop
        > ! go version
        [stderr]
        go: exec C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-1912840985\tmpdir1935926708\testbin\go.exe: fork/exec C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-1912840985\tmpdir1935926708\testbin\go.exe: The paging file is too small for this operation to complete.
        [exit status 1]
        > stderr -count=10 '^go: switching from go1.21.1 to go1.21.99 \[depth 9[0-9]\]$'
    script_test.go:156: FAIL: testdata\script\gotoolchain_loop.txt:17: stderr -count=10 '^go: switching from go1.21.1 to go1.21.99 \[depth 9[0-9]\]$': found 0 matches for `(?m)^go: switching from go1.21.1 to go1.21.99 \[depth 9[0-9]\]$` in stderr
--- FAIL: TestScript/gotoolchain_loop (2.46s)

2024-05-13 21:10 go1.22-windows-arm64 release-branch.go1.22@d4a81ec7 cmd/go/internal/modfetch/codehost.TestReadZip/vgotest1/submod/v1.0.4/submod (log)

=== RUN   TestReadZip/vgotest1/submod/v1.0.4/submod
=== PAUSE TestReadZip/vgotest1/submod/v1.0.4/submod
=== CONT  TestReadZip/vgotest1/submod/v1.0.4/submod
    git_test.go:166: mkdir -p C:\Users\swarming\.swarming\w\ir\x\t\gitrepo-test-2413598398\modcache\cache\vcs # git3 http://127.0.0.1:51994/git/vgotest1
    git_test.go:166: # lock C:\Users\swarming\.swarming\w\ir\x\t\gitrepo-test-2413598398\modcache\cache\vcs\8c30bcf87bf8d975d16c860bb7a5b1d7b5e240d83793315e2154bd3ca46e3071.lock
    git_test.go:166: mkdir -p C:\Users\swarming\.swarming\w\ir\x\t\gitrepo-test-2413598398\modcache\cache\vcs\8c30bcf87bf8d975d16c860bb7a5b1d7b5e240d83793315e2154bd3ca46e3071 # git3 http://127.0.0.1:51994/git/vgotest1
    git_test.go:166: cd C:\Users\swarming\.swarming\w\ir\x\t\gitrepo-test-2413598398\modcache\cache\vcs\8c30bcf87bf8d975d16c860bb7a5b1d7b5e240d83793315e2154bd3ca46e3071; git init --bare
    git_test.go:166: 0.457s # cd C:\Users\swarming\.swarming\w\ir\x\t\gitrepo-test-2413598398\modcache\cache\vcs\8c30bcf87bf8d975d16c860bb7a5b1d7b5e240d83793315e2154bd3ca46e3071; git init --bare
    git_test.go:166: cd C:\Users\swarming\.swarming\w\ir\x\t\gitrepo-test-2413598398\modcache\cache\vcs\8c30bcf87bf8d975d16c860bb7a5b1d7b5e240d83793315e2154bd3ca46e3071; git remote add origin -- http://127.0.0.1:51994/git/vgotest1
    git_test.go:166: 0.144s # cd C:\Users\swarming\.swarming\w\ir\x\t\gitrepo-test-2413598398\modcache\cache\vcs\8c30bcf87bf8d975d16c860bb7a5b1d7b5e240d83793315e2154bd3ca46e3071; git remote add origin -- http://127.0.0.1:51994/git/vgotest1
...
module "github.com/rsc/vgotest1" // root go.mod
> cp stdout go.mod
> git add go.mod
[stderr]
fatal: not enough memory for initialization
2024/05/13 21:59:36 vgotest1.txt:64: git add go.mod: exit status 128
# get http://127.0.0.1:51994/git/vgotest1: 500 Internal Server Error (4.443s)
    git_test.go:430: ReadZip: unexpected error git ls-remote -q origin in C:\Users\swarming\.swarming\w\ir\x\t\gitrepo-test-2413598398\modcache\cache\vcs\8c30bcf87bf8d975d16c860bb7a5b1d7b5e240d83793315e2154bd3ca46e3071: exit status 128:
        	fatal: not enough memory for initialization
--- FAIL: TestReadZip/vgotest1/submod/v1.0.4/submod (5.61s)

2024-05-13 21:10 go1.22-windows-arm64 release-branch.go1.22@d4a81ec7 encoding/gob (log)

FAIL	encoding/gob	1.167s

— watchflakes

gopherbot · 2024-05-14T01:18:54Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-10 18:25 darwin-amd64-nocgo tools@487737a1 go@c98867d2 x/tools/gopls/internal/test/integration/misc (log)

serve.go:441: debug server listening at http://localhost:49314
serve.go:441: debug server listening at http://localhost:49315
fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0xa809f66]

goroutine 3 gp=0xc000006c40 m=0 mp=0xbf657c0 [running]:
runtime.throw({0xb34fe3d?, 0xc000065720?})
	/tmp/buildlet/go/src/runtime/panic.go:1027 +0x48 fp=0xc0000656f0 sp=0xc0000656c0 pc=0xa836ea8
runtime.sigpanic()
	/tmp/buildlet/go/src/runtime/signal_unix.go:884 +0x3c9 fp=0xc000065750 sp=0xc0000656f0 pc=0xa870769
...
net/http.(*Server).Serve(0xc0034fa3c0, {0xb833c70, 0xc0085a5f00})
	/tmp/buildlet/go/src/net/http/server.go:3272 +0x30c fp=0xc00c487ed8 sp=0xc00c487da8 pc=0xaf03f0c
net/http.Serve(...)
	/tmp/buildlet/go/src/net/http/server.go:2811
golang.org/x/tools/gopls/internal/debug.(*Instance).Serve.func1()
	/tmp/buildlet/gopath/src/golang.org/x/tools/gopls/internal/debug/serve.go:483 +0xa51 fp=0xc00c487fe0 sp=0xc00c487ed8 pc=0xb1d87b1
runtime.goexit({})
	/tmp/buildlet/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00c487fe8 sp=0xc00c487fe0 pc=0xa874f01
created by golang.org/x/tools/gopls/internal/debug.(*Instance).Serve in goroutine 5546
	/tmp/buildlet/gopath/src/golang.org/x/tools/gopls/internal/debug/serve.go:444 +0x445

— watchflakes

gopherbot · 2024-05-14T03:47:16Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-10 18:25 x_tools-go1.22-windows-arm64 tools@487737a1 release-branch.go1.22@362dcedf golang.org/x/tools/go/packages (log)

FAIL	golang.org/x/tools/go/packages	7.457s

2024-05-10 18:25 x_tools-go1.22-windows-arm64 tools@487737a1 release-branch.go1.22@362dcedf golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	4.854s

— watchflakes

gopherbot · 2024-05-15T13:55:07Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-14 02:42 x_tools-gotip-windows-arm64 tools@59d97970 go@3454ac0d [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
# bootstrap/cmd/link
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff6f1554a8e?, 0x4006646000?})
	c:/go/src/runtime/panic.go:1047 +0x40 fp=0xf0b57ffcc0 sp=0xf0b57ffc90 pc=0x7ff6f1316330
runtime.sysUsedOS(0x4006646000, 0x2000)
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff698dcfb4f?, 0x401b238000?})
	c:/go/src/runtime/panic.go:1047 +0x40 fp=0x1ecd3ffa10 sp=0x1ecd3ff9e0 pc=0x7ff698519530
runtime.sysUsedOS(0x401b238000, 0xa000)
	c:/go/src/runtime/mem_windows.go:83 +0x178 fp=0x1ecd3ffa70 sp=0x1ecd3ffa10 pc=0x7ff6984f7278
runtime.sysUsed(0x7ff6994cbda0?, 0x1fb3694e2a0?, 0x1ecd3f0000?)
	c:/go/src/runtime/mem.go:77 +0x54 fp=0x1ecd3ffa90 sp=0x1ecd3ffa70 pc=0x7ff6984f6df4
runtime.(*mheap).allocSpan(0x7ff6994cbda0, 0x5, 0x0, 0x10?)
...
	c:/go/src/cmd/compile/internal/ssagen/pgen.go:185 +0x30 fp=0x401b1a3f60 sp=0x401b1a3e90 pc=0x7ff698b21dd0
cmd/compile/internal/gc.compileFunctions.func5.1(0x8?)
	c:/go/src/cmd/compile/internal/gc/compile.go:171 +0x3c fp=0x401b1a3fa0 sp=0x401b1a3f60 pc=0x7ff698ccc6dc
cmd/compile/internal/gc.compileFunctions.func3.1()
	c:/go/src/cmd/compile/internal/gc/compile.go:153 +0x38 fp=0x401b1a3fd0 sp=0x401b1a3fa0 pc=0x7ff698ccca78
runtime.goexit()
	c:/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x401b1a3fd0 sp=0x401b1a3fd0 pc=0x7ff69854bc94
created by cmd/compile/internal/gc.compileFunctions.func3
	c:/go/src/cmd/compile/internal/gc/compile.go:152 +0x1dc
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap\bin\go install -tags=math_big_pure_go compiler_bootstrap purego bootstrap/cmd/...: exit status 1

2024-05-14 15:30 x_telemetry-gotip-windows-arm64 telemetry@4a0682cf go@0767ffdf [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
# bootstrap/cmd/link/internal/s390x
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff69692fb4f?, 0x40004bf000?})
	c:/go/src/runtime/panic.go:1047 +0x40 fp=0x93199ff7d0 sp=0x93199ff7a0 pc=0x7ff696079530
runtime.sysUsedOS(0x40004be000, 0x2000)
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff69692fb4f?, 0x4002233000?})
	c:/go/src/runtime/panic.go:1047 +0x40 fp=0xe0bfffdb0 sp=0xe0bfffd80 pc=0x7ff696079530
runtime.sysUsedOS(0x4002232000, 0x2000)
	c:/go/src/runtime/mem_windows.go:83 +0x178 fp=0xe0bfffe10 sp=0xe0bfffdb0 pc=0x7ff696057278
runtime.sysUsed(0x7ff69702bda0?, 0x129622eb1f8?, 0x4000040d00?)
	c:/go/src/runtime/mem.go:77 +0x54 fp=0xe0bfffe30 sp=0xe0bfffe10 pc=0x7ff696056df4
runtime.(*mheap).allocSpan(0x7ff69702bda0, 0x1, 0x0, 0x0?)
...
	c:/go/src/runtime/mem_windows.go:83 +0x178 fp=0x5508fffc70 sp=0x5508fffc10 pc=0x7ff696057278
runtime.sysUsed(0x7ff69702bda0?, 0x21154ec4a38?, 0x5508ff0500?)
	c:/go/src/runtime/mem.go:77 +0x54 fp=0x5508fffc90 sp=0x5508fffc70 pc=0x7ff696056df4
runtime.(*mheap).allocSpan(0x7ff69702bda0, 0x1, 0x0, 0x10?)
	c:/go/src/runtime/mheap.go:1340 +0x3b4 fp=0x5508fffd20 sp=0x5508fffc90 pc=0x7ff696068d04
runtime.(*mheap).alloc.func1()
	c:/go/src/runtime/mheap.go:961 +0x6c fp=0x5508fffd70 sp=0x5508fffd20 pc=0x7ff69606857c
runtime.systemstack()
	c:/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x5508fffd80 sp=0x5508fffd70 pc=0x7ff6960a977c
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap\bin\go install -tags=math_big_pure_go compiler_bootstrap purego bootstrap/cmd/...: exit status 1

2024-05-14 17:12 x_tools-go1.21-windows-arm64 tools@0006edc4 release-branch.go1.21@0fa334d4 [build] (log)

[I2024-05-14T17:33:32.658781Z 21380 0 sink.go:276] SinkServer: warm-up started
[I2024-05-14T17:33:32.658781Z 21380 0 sink.go:346] SinkServer: starting HTTP server...
[I2024-05-14T17:33:32.660948Z 21380 0 sink.go:281] SinkServer: warm-up ended
[I2024-05-14T17:33:32.661475Z 21380 0 cmd_stream.go:475] rdb-stream: starting the test command - ["C:\\Users\\swarming\\.swarming\\w\\ir\\cache\\tools\\bin\\result_adapter.exe" "go" "-v=false" "--" "C:\\Users\\swarming\\.swarming\\w\\ir\\x\\w\\goroot\\bin\\go" "test" "-json" "-short" "./..."]
fatal error: runtime: cannot allocate memory

runtime stack:
runtime.throw({0x7ff7bad6e095?, 0x0?})
	runtime/panic.go:1023 +0x40 fp=0x1cfafff760 sp=0x1cfafff730 pc=0x7ff7ba5eb8b0
runtime.newArenaMayUnlock()
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff621faa949?, 0x400bf61000?})
	runtime/panic.go:1077 +0x40 fp=0x1ef65ffbd0 sp=0x1ef65ffba0 pc=0x7ff621d48d20
runtime.sysUsedOS(0x400b7ea000, 0xdd0000)
	runtime/mem_windows.go:83 +0x17c fp=0x1ef65ffc30 sp=0x1ef65ffbd0 pc=0x7ff621d26c0c
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff6221bc680, 0x6e8, 0x0, 0x69?)
...
runtime.gopark(0x4000ffffa0?, 0x2?, 0xe0?, 0x6?, 0x4000ffff4c?)
	runtime/proc.go:398 +0xc8 fp=0x4000fffdf0 sp=0x4000fffdd0 pc=0x7ff6bb7dd478
runtime.selectgo(0x4000ffffa0, 0x4000ffff48, 0x4000f5f340?, 0x0, 0x40004ac040?, 0x1)
	runtime/select.go:327 +0x618 fp=0x4000ffff00 sp=0x4000fffdf0 pc=0x7ff6bb7ed2a8
cmd/go/internal/work.(*Builder).Do.func4()
	cmd/go/internal/work/exec.go:209 +0xdc fp=0x4000ffffd0 sp=0x4000ffff00 pc=0x7ff6bbc1db6c
runtime.goexit()
	runtime/asm_arm64.s:1197 +0x4 fp=0x4000ffffd0 sp=0x4000ffffd0 pc=0x7ff6bb80e0a4
created by cmd/go/internal/work.(*Builder).Do in goroutine 1
	cmd/go/internal/work/exec.go:205 +0x34c

2024-05-14 17:12 x_tools-gotip-windows-arm64 tools@0006edc4 go@0767ffdf [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
# bootstrap/cmd/link/internal/ld
runtime: VirtualAlloc of 32768 bytes failed with errno=1455
fatal error: out of memory
runtime: VirtualAlloc of 32768 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff69692fb4f?, 0x4009c78000?})
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff69692fb4f?, 0x4007b3a000?})
	c:/go/src/runtime/panic.go:1047 +0x40 fp=0x4ae65ff3b0 sp=0x4ae65ff380 pc=0x7ff696079530
runtime.sysUsedOS(0x4007b3a000, 0x2000)
	c:/go/src/runtime/mem_windows.go:83 +0x178 fp=0x4ae65ff410 sp=0x4ae65ff3b0 pc=0x7ff696057278
runtime.sysUsed(0x7ff69702bda0?, 0x1c942f99ce8?, 0x4000?)
	c:/go/src/runtime/mem.go:77 +0x54 fp=0x4ae65ff430 sp=0x4ae65ff410 pc=0x7ff696056df4
runtime.(*mheap).allocSpan(0x7ff69702bda0, 0x1, 0x0, 0x80?)
...
	c:/go/src/cmd/compile/internal/ssagen/pgen.go:185 +0x30 fp=0x40027d7f60 sp=0x40027d7e90 pc=0x7ff696681dd0
cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
	c:/go/src/cmd/compile/internal/gc/compile.go:171 +0x3c fp=0x40027d7fa0 sp=0x40027d7f60 pc=0x7ff69682c6dc
cmd/compile/internal/gc.compileFunctions.func3.1()
	c:/go/src/cmd/compile/internal/gc/compile.go:153 +0x38 fp=0x40027d7fd0 sp=0x40027d7fa0 pc=0x7ff69682ca78
runtime.goexit()
	c:/go/src/runtime/asm_arm64.s:1172 +0x4 fp=0x40027d7fd0 sp=0x40027d7fd0 pc=0x7ff6960abc94
created by cmd/compile/internal/gc.compileFunctions.func3
	c:/go/src/cmd/compile/internal/gc/compile.go:152 +0x1dc
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap\bin\go install -tags=math_big_pure_go compiler_bootstrap purego bootstrap/cmd/...: exit status 1

2024-05-14 18:26 x_telemetry-go1.21-windows-arm64 telemetry@7d78a974 release-branch.go1.21@0fa334d4 [build] (log)

[I2024-05-14T18:30:15.993253Z 28032 0 sink.go:276] SinkServer: warm-up started
[I2024-05-14T18:30:15.993253Z 28032 0 sink.go:346] SinkServer: starting HTTP server...
[I2024-05-14T18:30:15.994849Z 28032 0 sink.go:281] SinkServer: warm-up ended
[I2024-05-14T18:30:15.995391Z 28032 0 cmd_stream.go:475] rdb-stream: starting the test command - ["C:\\Users\\swarming\\.swarming\\w\\ir\\cache\\tools\\bin\\result_adapter.exe" "go" "-v=false" "--" "C:\\Users\\swarming\\.swarming\\w\\ir\\x\\w\\goroot\\bin\\go" "test" "-json" "-short" "./..."]
# golang.org/x/text/unicode/norm
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff68fbbfae2?, 0x400286b000?})
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff68fbbfae2?, 0x4002fe0000?})
	runtime/panic.go:1077 +0x40 fp=0x6b2b5ffaf0 sp=0x6b2b5ffac0 pc=0x7ff68f335880
runtime.sysUsedOS(0x4002fe0000, 0x2000)
	runtime/mem_windows.go:83 +0x17c fp=0x6b2b5ffb50 sp=0x6b2b5ffaf0 pc=0x7ff68f30dd4c
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff6902a96a0, 0x1, 0x0, 0x0?)
...
github.com/evanw/esbuild/internal/api_helpers: open C:\Users\swarming\.swarming\w\ir\x\t\go-build302215394\b425\importcfg: The system cannot find the path specified.
[I2024-05-14T18:30:21.565331Z 28032 0 cmd_stream.go:471] rdb-stream: the test process terminated
[I2024-05-14T18:30:21.565845Z 28032 0 sink.go:371] SinkServer: shutdown started
[I2024-05-14T18:30:21.565845Z 28032 0 sink.go:349] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-05-14T18:30:21.565845Z 28032 0 sink_server.go:95] SinkServer: draining TestResult channel started
[I2024-05-14T18:30:21.565845Z 28032 0 sink_server.go:97] SinkServer: draining TestResult channel ended
[I2024-05-14T18:30:21.565845Z 28032 0 sink_server.go:99] SinkServer: draining Artifact channel started
[I2024-05-14T18:30:21.565845Z 28032 0 sink_server.go:101] SinkServer: draining Artifact channel ended
[I2024-05-14T18:30:21.565845Z 28032 0 sink.go:374] SinkServer: shutdown completed successfully
[I2024-05-14T18:30:21.566390Z 28032 0 cmd_stream.go:403] rdb-stream: exiting with 1

2024-05-14 18:26 x_telemetry-go1.22-windows-arm64 telemetry@7d78a974 release-branch.go1.22@362dcedf golang.org/x/telemetry/godev/cmd/telemetrygodev (log)

FAIL	golang.org/x/telemetry/godev/cmd/telemetrygodev [build failed]

2024-05-14 18:26 x_telemetry-go1.22-windows-arm64 telemetry@7d78a974 release-branch.go1.22@362dcedf golang.org/x/telemetry/godev/cmd/worker (log)

FAIL	golang.org/x/telemetry/godev/cmd/worker [build failed]

2024-05-14 18:26 x_telemetry-go1.22-windows-arm64 telemetry@7d78a974 release-branch.go1.22@362dcedf golang.org/x/telemetry/godev/internal/storage (log)

FAIL	golang.org/x/telemetry/godev/internal/storage [build failed]

2024-05-14 18:28 x_tools-go1.21-wasip1-wasm_wasmtime tools@e8808ed5 release-branch.go1.21@0fa334d4 golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	56.698s

— watchflakes

gopherbot · 2024-05-15T22:27:59Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-15 12:20 gotip-windows-arm64 go@bbdad50c runtime:cpu2 (log)

FAIL	runtime [build failed]

2024-05-15 13:08 x_tools-go1.22-windows-arm64 tools@d40dfd59 release-branch.go1.22@362dcedf golang.org/x/tools/benchmark/parse (log)

FAIL	golang.org/x/tools/benchmark/parse [build failed]

2024-05-15 13:08 x_tools-go1.22-windows-arm64 tools@d40dfd59 release-branch.go1.22@362dcedf golang.org/x/tools/blog (log)

FAIL	golang.org/x/tools/blog [build failed]

2024-05-15 13:08 x_tools-go1.22-windows-arm64 tools@d40dfd59 release-branch.go1.22@362dcedf golang.org/x/tools/cmd/auth/authtest (log)

FAIL	golang.org/x/tools/cmd/auth/authtest [build failed]

2024-05-15 17:29 gotip-windows-arm64 go@bf0b605d [build] (log)

[I2024-05-15T19:11:22.609468Z 14272 0 sink.go:276] SinkServer: warm-up started
[I2024-05-15T19:11:22.609468Z 14272 0 sink.go:346] SinkServer: starting HTTP server...
[I2024-05-15T19:11:22.612073Z 14272 0 sink.go:281] SinkServer: warm-up ended
[I2024-05-15T19:11:22.612610Z 14272 0 cmd_stream.go:475] rdb-stream: starting the test command - ["C:\\Users\\swarming\\.swarming\\w\\ir\\cache\\tools\\bin\\result_adapter.exe" "go" "-v=false" "--" "C:\\Users\\swarming\\.swarming\\w\\ir\\x\\w\\goroot\\bin\\go" "tool" "dist" "test" "-json"]
go: remove C:\Users\swarming\.swarming\w\ir\x\t\go-build257061216\b2215\go.test.exe: Access is denied.
go tool dist: Failed: exit status 1
ok  	archive/tar	0.222s
ok  	archive/zip	0.541s
ok  	bufio	0.335s
ok  	bytes	0.260s
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff6cbe99531?, 0x400090e000?})
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1026 +0x38 fp=0x1e03dff880 sp=0x1e03dff850 pc=0x7ff6cb75f038
runtime.sysUsedOS(0x400090e000, 0x8000)
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mem_windows.go:83 +0x178 fp=0x1e03dff8e0 sp=0x1e03dff880 pc=0x7ff6cb73ae08
runtime.sysUsed(...)
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff6cc42e540, 0x4, 0x3, 0x0)
...
os/exec.(*Cmd).watchCtx(0x40000dc6e0, 0x4000216240)
	os/exec/exec.go:764 +0x7c fp=0x4000443fb0 sp=0x4000443e70 pc=0x7ff7772f19fc
os/exec.(*Cmd).Start.gowrap2()
	os/exec/exec.go:750 +0x2c fp=0x4000443fd0 sp=0x4000443fb0 pc=0x7ff7772f16fc
runtime.goexit({})
	runtime/asm_arm64.s:1222 +0x4 fp=0x4000443fd0 sp=0x4000443fd0 pc=0x7ff77723fe84
created by os/exec.(*Cmd).Start in goroutine 1
	os/exec/exec.go:750 +0x7fc
RPC failed permanently: rpc error: code = Internal desc = prpc: sending request: Post "http://localhost:56060/prpc/luci.resultsink.v1.Sink/ReportTestResults": read tcp 127.0.0.1:60709->127.0.0.1:56060: wsarecv: An existing connection was forcibly closed by the remote host. {"host":"localhost:56060", "method":"ReportTestResults", "service":"luci.resultsink.v1.Sink"}
result_adapter: rpc error: code = Internal desc = prpc: sending request: Post "http://localhost:56060/prpc/luci.resultsink.v1.Sink/ReportTestResults": read tcp 127.0.0.1:60709->127.0.0.1:56060: wsarecv: An existing connection was forcibly closed by the remote host.

— watchflakes

gopherbot · 2024-05-16T08:27:23Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-16 01:45 gotip-windows-arm64 go@8ce2feda cmd/go.TestScript/work_issue54372 (log)

=== RUN   TestScript/work_issue54372
=== PAUSE TestScript/work_issue54372
=== CONT  TestScript/work_issue54372
    script_test.go:135: 2024-05-16T07:30:24Z
    script_test.go:137: $WORK=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-3753799972\tmpdir1058398312\work_issue543722694025411
    script_test.go:159: 
        PATH=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-3753799972\tmpdir1058398312\testbin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\cache\tools\bin;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3\bin;C:\Users\swarming\.swarming\w\ir\cache\cipd_client;C:\Users\swarming\.swarming\w\ir\cache\cipd_client\bin;C:\Users\swarming\.swarming\cipd_cache\bin;C:\Python311\Scripts\;C:\Python311\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\ProgramData\chocolatey\bin;C:\Users\swarming\AppData\Local\Microsoft\WindowsApps;C:\Users\swarming\.swarming\w\ir\cache\tools\cc\windows\gcc64\bin
        USERPROFILE=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        fatal error: out of memory
        
        runtime stack:
        runtime.throw({0x7ff622449531?, 0x4000262000?})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1026 +0x38 fp=0x95a61ff890 sp=0x95a61ff860 pc=0x7ff621d45808
        runtime.sysUsedOS(0x4000262000, 0x2000)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mem_windows.go:83 +0x178 fp=0x95a61ff8f0 sp=0x95a61ff890 pc=0x7ff621cead18
        runtime.sysUsed(...)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mem.go:77
        runtime.(*mheap).allocSpan(0x7ff6229de540, 0x1, 0x0, 0x4c)
...
        cmd/go/internal/modcmd.verifyMod({0x7ff622597720, 0x7ff622a1e5a0}, {{0x40001ac030?, 0x0?}, {0x40001ac028?, 0x0?}})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/cmd/go/internal/modcmd/verify.go:106 +0x13c fp=0x40001e7f60 sp=0x40001e7de0 pc=0x7ff62228136c
        cmd/go/internal/modcmd.runVerify.func1()
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/cmd/go/internal/modcmd/verify.go:74 +0x44 fp=0x40001e7fd0 sp=0x40001e7f60 pc=0x7ff6222811f4
        runtime.goexit({})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1223 +0x4 fp=0x40001e7fd0 sp=0x40001e7fd0 pc=0x7ff621d4b7e4
        created by cmd/go/internal/modcmd.runVerify in goroutine 1
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/cmd/go/internal/modcmd/verify.go:73 +0x110
    script_test.go:159: FAIL: testdata\script\work_issue54372.txt:4: go mod verify: exit status 2
--- FAIL: TestScript/work_issue54372 (0.09s)

— watchflakes

gopherbot · 2024-05-16T23:29:07Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-15 22:01 x_tools-go1.21-wasip1-wasm_wazero tools@b92578a5 release-branch.go1.21@e9f3c9b7 golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	49.557s

2024-05-15 22:01 x_tools-go1.21-wasip1-wasm_wazero tools@b92578a5 release-branch.go1.21@e9f3c9b7 x/tools/go/ssa.TestTypeparamTest/double.go [ABORT] (log)

=== RUN   TestTypeparamTest/double.go
    builder_test.go:803: Input: /home/swarming/.swarming/w/ir/x/w/goroot/test/typeparam/double.go
runtime: marked free object in span 0x24ceab8, elemsize=64 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
0x10a50000 free  marked   zombie
0x0000000010a50000:  0x0000000000000007  0x000000000012c690 
0x0000000010a50010:  0x00000000050a4480  0x000000000012af18 
0x0000000010a50020:  0x000000000049e1a0  0x0000000000000000 
0x0000000010a50030:  0x0000000000000000  0x0000000000000000 
0x10a50040 free  unmarked
0x10a50080 free  unmarked
...
fatal error: found pointer to free object

goroutine 631 [running]:
runtime.throw({0xb1dce, 0x1c})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1077 +0x3 fp=0x1899680 sp=0x1899658 pc=0x12760003
runtime.(*mspan).reportZombies(0x24ceab8)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgcsweep.go:861 +0x61 fp=0x18996f8 sp=0x1899680 pc=0x119f0061
runtime.(*sweepLocked).sweep(0x1899858, 0x1)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgcsweep.go:639 +0x77 fp=0x1899818 sp=0x18996f8 pc=0x119b0077
runtime.(*mcentral).cacheSpan(0x4b1eb8)
...
golang.org/x/tools/go/ssa_test.TestTypeparamTest.func1(0xb04f1e0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2742893225/go/ssa/builder_test.go:816 +0x47 fp=0xb0d9f60 sp=0xb0d9dd8 pc=0x29150047
testing.tRunner(0xb04f1e0, 0x4002660)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1595 +0xc fp=0xb0d9fc8 sp=0xb0d9f60 pc=0x199c000c
testing.(*T).Run.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1648 +0x2 fp=0xb0d9fe0 sp=0xb0d9fc8 pc=0x19a20002
runtime.goexit()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_wasm.s:401 +0x1 fp=0xb0d9fe8 sp=0xb0d9fe0 pc=0x14e70001
created by testing.(*T).Run in goroutine 517
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1648 +0x47

2024-05-15 22:01 x_tools-gotip-js-wasm tools@b92578a5 go@6ed31e3c golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	18.429s

— watchflakes

gopherbot · 2024-05-17T17:27:55Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-17 16:49 x_tools-gotip-wasip1-wasm_wasmtime tools@499663ef go@003683f4 golang.org/x/tools/go/ssa (log)

FAIL	golang.org/x/tools/go/ssa	65.501s

— watchflakes

gopherbot · 2024-05-18T01:27:37Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-17 18:37 gotip-windows-arm64 go@192d65e4 cmd/compile/internal/amd64 (log)

FAIL	cmd/compile/internal/amd64 [build failed]

2024-05-17 18:37 gotip-windows-arm64 go@192d65e4 cmd/compile/internal/dwarfgen (log)

FAIL	cmd/compile/internal/dwarfgen [build failed]

2024-05-17 18:37 gotip-windows-arm64 go@192d65e4 cmd/compile/internal/liveness (log)

FAIL	cmd/compile/internal/liveness [build failed]

— watchflakes

gopherbot · 2024-05-18T02:27:48Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-17 18:28 gotip-windows-arm64 go@e95f6af0 [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for windows/arm64.
# cmd/go/internal/trace
fatal error: runtime: cannot allocate memory

runtime stack:
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff71d48f912?, 0x4000cae000?})
	runtime/panic.go:1027 +0x38 fp=0xa046fffae0 sp=0xa046fffab0 pc=0x7ff71c9eec28
runtime.sysUsedOS(0x4000cae000, 0x4000)
	runtime/mem_windows.go:83 +0x178 fp=0xa046fffb40 sp=0xa046fffae0 pc=0x7ff71c98ce38
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff71dd5f100, 0x2, 0x0, 0x76)
...
	cmd/compile/internal/ssagen/pgen.go:302 +0x70 fp=0x4001219f60 sp=0x4001219e80 pc=0x7ff71d1678e0
cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
	cmd/compile/internal/gc/compile.go:183 +0x40 fp=0x4001219fa0 sp=0x4001219f60 pc=0x7ff71d328880
cmd/compile/internal/gc.compileFunctions.func3.1()
	cmd/compile/internal/gc/compile.go:165 +0x3c fp=0x4001219fd0 sp=0x4001219fa0 pc=0x7ff71d328bec
runtime.goexit({})
	runtime/asm_arm64.s:1223 +0x4 fp=0x4001219fd0 sp=0x4001219fd0 pc=0x7ff71c9f56f4
created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 137
	cmd/compile/internal/gc/compile.go:164 +0x1e0
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install cmd: exit status 1

2024-05-17 18:31 gotip-windows-arm64 go@664088b8 archive/tar (log)

FAIL	archive/tar [build failed]

2024-05-17 18:31 gotip-windows-arm64 go@664088b8 archive/zip (log)

FAIL	archive/zip [build failed]

2024-05-17 18:31 gotip-windows-arm64 go@664088b8 bufio (log)

FAIL	bufio [build failed]

— watchflakes

gopherbot · 2024-05-18T03:27:54Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-17 15:41 gotip-windows-arm64 go@2c635b68 cmd/compile/internal/amd64 (log)

FAIL	cmd/compile/internal/amd64 [build failed]

2024-05-17 15:41 gotip-windows-arm64 go@2c635b68 cmd/compile/internal/dwarfgen (log)

FAIL	cmd/compile/internal/dwarfgen [build failed]

2024-05-17 15:41 gotip-windows-arm64 go@2c635b68 cmd/compile/internal/liveness (log)

FAIL	cmd/compile/internal/liveness [build failed]

2024-05-17 16:48 gotip-windows-arm64 go@41aab30b archive/tar (log)

FAIL	archive/tar [build failed]

2024-05-17 16:48 gotip-windows-arm64 go@41aab30b archive/zip (log)

FAIL	archive/zip [build failed]

2024-05-17 16:48 gotip-windows-arm64 go@41aab30b bufio (log)

FAIL	bufio [build failed]

2024-05-17 16:59 gotip-windows-arm64 go@003683f4 archive/tar (log)

FAIL	archive/tar [build failed]

2024-05-17 16:59 gotip-windows-arm64 go@003683f4 archive/zip (log)

FAIL	archive/zip [build failed]

2024-05-17 16:59 gotip-windows-arm64 go@003683f4 bufio (log)

FAIL	bufio [build failed]

2024-05-17 17:09 x_tools-gotip-windows-arm64 tools@de1032b1 go@1667dbd7 [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for windows/arm64.
# cmd/go/internal/modfetch/codehost
runtime: VirtualAlloc of 2007040 bytes failed with errno=1455
fatal error: out of memory

...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff630c9f9f2?, 0x4000319000?})
	runtime/panic.go:1027 +0x38 fp=0xa1c33ff620 sp=0xa1c33ff5f0 pc=0x7ff6301fec38
runtime.sysUsedOS(0x4000180000, 0x1ea000)
	runtime/mem_windows.go:83 +0x178 fp=0xa1c33ff680 sp=0xa1c33ff620 pc=0x7ff63019ce38
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff631570100, 0xf5, 0x0, 0x0)
...
	cmd/compile/internal/ssagen/pgen.go:302 +0x70 fp=0x4027035f60 sp=0x4027035e80 pc=0x7ff630977e30
cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
	cmd/compile/internal/gc/compile.go:183 +0x40 fp=0x4027035fa0 sp=0x4027035f60 pc=0x7ff630b38dd0
cmd/compile/internal/gc.compileFunctions.func3.1()
	cmd/compile/internal/gc/compile.go:165 +0x3c fp=0x4027035fd0 sp=0x4027035fa0 pc=0x7ff630b3913c
runtime.goexit({})
	runtime/asm_arm64.s:1223 +0x4 fp=0x4027035fd0 sp=0x4027035fd0 pc=0x7ff630205704
created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 63
	cmd/compile/internal/gc/compile.go:164 +0x1e0
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install cmd: exit status 1

— watchflakes

gopherbot · 2024-05-18T04:27:55Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-17 16:36 x_tools-gotip-windows-arm64 tools@c184dd7d go@1667dbd7 [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
# cmd/compile/internal/ssa
runtime: VirtualAlloc of 122880 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff609d819bc?, 0x4025744000?})
...
	..\..\w\goroot\src\cmd\compile\internal\ssagen/pgen.go:302 +0x68 fp=0x4023837f60 sp=0x4023837e90 pc=0x7ff609abda88
bootstrap/cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
	..\..\w\goroot\src\cmd\compile\internal/gc/compile.go:183 +0x40 fp=0x4023837fa0 sp=0x4023837f60 pc=0x7ff609c71f70
bootstrap/cmd/compile/internal/gc.compileFunctions.func3.1()
	..\..\w\goroot\src\cmd\compile\internal/gc/compile.go:165 +0x38 fp=0x4023837fd0 sp=0x4023837fa0 pc=0x7ff609c722f8
runtime.goexit()
	..\..\../cache/tools/go_bootstrap/src/runtime/asm_arm64.s:1172 +0x4 fp=0x4023837fd0 sp=0x4023837fd0 pc=0x7ff6096abf04
created by bootstrap/cmd/compile/internal/gc.compileFunctions.func3
	..\..\w\goroot\src\cmd\compile\internal/gc/compile.go:164 +0x1dc
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install -pgo=off cmd/asm cmd/cgo cmd/compile cmd/link cmd/preprofile: exit status 1

2024-05-17 16:49 x_tools-gotip-windows-arm64 tools@499663ef go@1667dbd7 [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for windows/arm64.
# cmd/doc
runtime: VirtualAlloc of 638976 bytes failed with errno=1455
fatal error: out of memory

...
fatal error: runtime: cannot allocate memory

goroutine 1 gp=0x400004c000 m=0 mp=0x7ff74898f220 [running, locked to thread]:
runtime.throw({0x7ff7480f7724?, 0x7ff74762e230?})
	runtime/panic.go:1027 +0x38 fp=0x4000053b20 sp=0x4000053af0 pc=0x7ff74763ec38
runtime.stkbucket(0x1, 0x2000, {0x4000004000, 0x8, 0x1c77e163a28?}, 0x1)
	runtime/mprof.go:275 +0x3f4 fp=0x4000053b80 sp=0x4000053b20 pc=0x7ff7475f9284
runtime.mProf_Malloc(0x7ff74898f220, 0x400013a008, 0x2000)
	runtime/mprof.go:432 +0xb0 fp=0x4000053c10 sp=0x4000053b80 pc=0x7ff7475f96a0
runtime.profilealloc(0x7ff74898f220?, 0x400013a008?, 0x2000?)
...
	runtime/mem_windows.go:83 +0x178 fp=0xc91b9ffab0 sp=0xc91b9ffa50 pc=0x7ff7475dce38
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff7489b0100, 0x1, 0x0, 0x14)
	runtime/mheap.go:1345 +0x88c fp=0xc91b9ffbd0 sp=0xc91b9ffab0 pc=0x7ff7475f1eac
runtime.(*mheap).alloc.func1()
	runtime/mheap.go:962 +0x6c fp=0xc91b9ffc20 sp=0xc91b9ffbd0 pc=0x7ff7475f10dc
runtime.systemstack(0x0)
	runtime/asm_arm64.s:244 +0x6c fp=0xc91b9ffc30 sp=0xc91b9ffc20 pc=0x7ff7476432dc
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install cmd: exit status 1

— watchflakes

gopherbot · 2024-05-21T21:24:49Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-16 22:34 x_net-gotip-windows-arm64 net@c87a5b62 go@e7bf9959 [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for windows/arm64.
# archive/tar
fatal error: runtime: cannot allocate memory
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff79a98f9f2?, 0x401dd14000?})
	runtime/panic.go:1027 +0x38 fp=0x9bd55ff6e0 sp=0x9bd55ff6b0 pc=0x7ff799eeec38
runtime.sysUsedOS(0x401dd14000, 0x2000)
	runtime/mem_windows.go:83 +0x178 fp=0x9bd55ff740 sp=0x9bd55ff6e0 pc=0x7ff799e8ce38
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff79b260100, 0x1, 0x0, 0x4)
...
	runtime/proc.go:402 +0xc8 fp=0x4003dc3f10 sp=0x4003dc3ef0 pc=0x7ff799eeed58
runtime.gcBgMarkWorker(0x40026d6150)
	runtime/mgc.go:1352 +0xdc fp=0x4003dc3fb0 sp=0x4003dc3f10 pc=0x7ff799e925ac
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1268 +0x28 fp=0x4003dc3fd0 sp=0x4003dc3fb0 pc=0x7ff799e92498
runtime.goexit({})
	runtime/asm_arm64.s:1223 +0x4 fp=0x4003dc3fd0 sp=0x4003dc3fd0 pc=0x7ff799ef5704
created by runtime.gcBgMarkStartWorkers in goroutine 61
	runtime/mgc.go:1268 +0x140
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install cmd: exit status 1

2024-05-17 18:54 x_telemetry-gotip-windows-arm64 telemetry@3f1148c7 go@e7bf9959 [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for windows/arm64.
# cmd/distpack
fatal error: runtime: cannot allocate memory

runtime stack:
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff7a5b0d97e?, 0x4007c6c000?})
	runtime/panic.go:1027 +0x38 fp=0xee5afffb30 sp=0xee5afffb00 pc=0x7ff7a570f8c8
runtime.sysUsedOS(0x4007b00000, 0x26c000)
	runtime/mem_windows.go:83 +0x178 fp=0xee5afffb90 sp=0xee5afffb30 pc=0x7ff7a56b6438
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff7a5e97b40, 0x136, 0x0, 0x1)
...
	runtime/mem_windows.go:83 +0x178 fp=0x3638dff720 sp=0x3638dff6c0 pc=0x7ff7f283ce38
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff7f3c10100, 0x1, 0x0, 0x38)
	runtime/mheap.go:1345 +0x88c fp=0x3638dff840 sp=0x3638dff720 pc=0x7ff7f2851eac
runtime.(*mheap).alloc.func1()
	runtime/mheap.go:962 +0x6c fp=0x3638dff890 sp=0x3638dff840 pc=0x7ff7f28510dc
runtime.systemstack(0x0)
	runtime/asm_arm64.s:244 +0x6c fp=0x3638dff8a0 sp=0x3638dff890 pc=0x7ff7f28a32dc
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install cmd: exit status 1

2024-05-17 20:25 x_tools-go1.21-windows-arm64 tools@8cf8c6f7 release-branch.go1.21@6f521957 golang.org/x/tools/cmd/callgraph (log)

FAIL	golang.org/x/tools/cmd/callgraph	6.625s

2024-05-17 20:25 x_tools-go1.21-windows-arm64 tools@8cf8c6f7 release-branch.go1.21@6f521957 x/tools/cmd/callgraph.TestCallgraph [ABORT] (log)

=== RUN   TestCallgraph
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff7dc022380?, 0x4011760000?})
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1077 +0x40 fp=0x2723fff810 sp=0x2723fff7e0 pc=0x7ff7dbcdc210
runtime.sysUsedOS(0x4011760000, 0x2000)
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mem_windows.go:83 +0x17c fp=0x2723fff870 sp=0x2723fff810 pc=0x7ff7dbcb97fc
runtime.sysUsed(...)
...

goroutine 53 [GC worker (idle)]:
runtime.gopark(0x5aac154e5a40?, 0x1?, 0x30?, 0x8f?, 0x0?)
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/proc.go:398 +0xc8 fp=0x40003f7f30 sp=0x40003f7f10 pc=0x7ff7dbcdedc8
runtime.gcBgMarkWorker()
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1295 +0xd8 fp=0x40003f7fd0 sp=0x40003f7f30 pc=0x7ff7dbcbe188
runtime.goexit()
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1197 +0x4 fp=0x40003f7fd0 sp=0x40003f7fd0 pc=0x7ff7dbd10a34
created by runtime.gcBgMarkStartWorkers in goroutine 67
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1219 +0x28

2024-05-17 20:25 x_tools-go1.21-windows-arm64 tools@8cf8c6f7 release-branch.go1.21@6f521957 golang.org/x/tools/go/analysis/passes/deepequalerrors (log)

FAIL	golang.org/x/tools/go/analysis/passes/deepequalerrors	3.275s

2024-05-17 21:14 x_tools-go1.21-windows-arm64 tools@0b4dca13 release-branch.go1.21@6f521957 x/tools/go/packages.TestLoadZeroConfig (log)

=== RUN   TestLoadZeroConfig
=== PAUSE TestLoadZeroConfig
=== CONT  TestLoadZeroConfig
    packages_test.go:109: err: exit status 1: stderr: fatal error: out of memory allocating heap arena map
        
        runtime stack:
        runtime.throw({0x7ff768f69a4d?, 0x0?})
        	runtime/panic.go:1077 +0x40 fp=0x240efff5a0 sp=0x240efff570 pc=0x7ff7686c5880
        runtime.(*mheap).sysAlloc(0x7ff7696396a0, 0x240efff720?, 0x7ff769649a60, 0x1)
        	runtime/malloc.go:741 +0x350 fp=0x240efff660 sp=0x240efff5a0 pc=0x7ff76868fc20
...
        	internal/cpu/cpu.go:125 +0x30 fp=0x240efffaf0 sp=0x240efffac0 pc=0x7ff768684370
        runtime.cpuinit(...)
        	runtime/proc.go:639
        runtime.schedinit()
        	runtime/proc.go:731 +0xcc fp=0x240efffb30 sp=0x240efffaf0 pc=0x7ff7686c8f7c
        runtime.rt0_go()
        	runtime/asm_arm64.s:86 +0xac fp=0x240efffb60 sp=0x240efffb30 pc=0x7ff7686fabbc
        go: error obtaining buildID for go tool compile: exit status 2
        
--- FAIL: TestLoadZeroConfig (1.09s)

2024-05-17 21:14 x_tools-go1.21-windows-arm64 tools@0b4dca13 release-branch.go1.21@6f521957 golang.org/x/tools/internal/gcimporter (log)

FAIL	golang.org/x/tools/internal/gcimporter	22.470s

2024-05-17 21:14 x_tools-go1.21-windows-arm64 tools@0b4dca13 release-branch.go1.21@6f521957 x/tools/internal/gcimporter.TestStdlib [ABORT] (log)

=== RUN   TestStdlib
fatal error: out of memory allocating heap arena metadata

runtime stack:
runtime.throw({0x7ff69750289a?, 0x0?})
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1077 +0x40 fp=0x5ed7fffc50 sp=0x5ed7fffc20 pc=0x7ff697218f20
runtime.(*mheap).sysAlloc(0x7ff697736820, 0x1?, 0x7ff697746be0, 0x1)
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/malloc.go:759 +0x330 fp=0x5ed7fffd10 sp=0x5ed7fffc50 pc=0x7ff6971ec1d0
runtime.(*mheap).grow(0x7ff697736820, 0x7ff697212cfc?)
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mheap.go:1483 +0x84 fp=0x5ed7fffd90 sp=0x5ed7fffd10 pc=0x7ff697209084
...

goroutine 25 [GC worker (idle)]:
runtime.gopark(0x7ff6977773c0?, 0x3?, 0x1c?, 0x10?, 0x0?)
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/proc.go:398 +0xc8 fp=0x4000205f30 sp=0x4000205f10 pc=0x7ff69721bad8
runtime.gcBgMarkWorker()
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1295 +0xd8 fp=0x4000205fd0 sp=0x4000205f30 pc=0x7ff6971fb4b8
runtime.goexit()
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1197 +0x4 fp=0x4000205fd0 sp=0x4000205fd0 pc=0x7ff69724cae4
created by runtime.gcBgMarkStartWorkers in goroutine 22
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1219 +0x28

2024-05-17 21:14 x_tools-gotip-windows-arm64 tools@0b4dca13 go@e7bf9959 [build] (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
# cmd/compile/internal/ssa
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff695fe19bc?, 0x4025a48000?})
...
	..\..\w\goroot\src\cmd\compile\internal\ssagen/pgen.go:312 +0x2c4 fp=0x40228adf60 sp=0x40228ade90 pc=0x7ff695d1dce4
bootstrap/cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
	..\..\w\goroot\src\cmd\compile\internal/gc/compile.go:183 +0x40 fp=0x40228adfa0 sp=0x40228adf60 pc=0x7ff695ed1f70
bootstrap/cmd/compile/internal/gc.compileFunctions.func3.1()
	..\..\w\goroot\src\cmd\compile\internal/gc/compile.go:165 +0x38 fp=0x40228adfd0 sp=0x40228adfa0 pc=0x7ff695ed22f8
runtime.goexit()
	..\..\../cache/tools/go_bootstrap/src/runtime/asm_arm64.s:1172 +0x4 fp=0x40228adfd0 sp=0x40228adfd0 pc=0x7ff69590bf04
created by bootstrap/cmd/compile/internal/gc.compileFunctions.func3
	..\..\w\goroot\src\cmd\compile\internal/gc/compile.go:164 +0x1dc
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install -pgo=off cmd/asm cmd/cgo cmd/compile cmd/link cmd/preprofile: exit status 1

— watchflakes

gopherbot · 2024-05-23T01:41:07Z

Found new dashboard test flakes for:

#!watchflakes
default <- (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`) &&
	builder != "plan9-386-0intro" &&
	builder != "plan9-amd64-0intro" &&
	builder != "plan9-arm" &&
	builder != "linux-loong64-3a5000" &&
	!(builder ~ `(gotip|go1\.\d\d)-` && date < "2024-01-18")

2024-05-22 02:04 gotip-windows-arm64 go@504212bb cmd/go.TestScript/devnull (log)

=== RUN   TestScript/devnull
=== PAUSE TestScript/devnull
=== CONT  TestScript/devnull
    script_test.go:135: 2024-05-22T03:00:18Z
    script_test.go:137: $WORK=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-2739778199\tmpdir172762841\devnull2659190589
    script_test.go:159: 
        PATH=C:\Users\swarming\.swarming\w\ir\x\t\cmd-go-test-2739778199\tmpdir172762841\testbin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\x\w\goroot\bin;C:\Users\swarming\.swarming\w\ir\cache\tools\bin;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages;C:\Users\swarming\.swarming\w\ir\bbagent_utility_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\bin;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3;C:\Users\swarming\.swarming\w\ir\cipd_bin_packages\cpython3\bin;C:\Users\swarming\.swarming\w\ir\cache\cipd_client;C:\Users\swarming\.swarming\w\ir\cache\cipd_client\bin;C:\Users\swarming\.swarming\cipd_cache\bin;C:\Python311\Scripts\;C:\Python311\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\ProgramData\chocolatey\bin;C:\Users\swarming\AppData\Local\Microsoft\WindowsApps;C:\Users\swarming\.swarming\w\ir\cache\tools\cc\windows\gcc64\bin
        USERPROFILE=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        fatal error: runtime.newosproc
        
        runtime stack:
        runtime.throw({0x7ff766c056fe?, 0x0?})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1047 +0x38 fp=0x9293ff510 sp=0x9293ff4e0 pc=0x7ff7664e59d8
        runtime.newosproc(0x9293ff5d8?)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/os_windows.go:780 +0xec fp=0x9293ff570 sp=0x9293ff510 pc=0x7ff7664ab09c
        runtime.newm1(0x40002f4008)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/proc.go:2762 +0xa8 fp=0x9293ff5b0 sp=0x9293ff570 pc=0x7ff7664b60b8
        runtime.newm(0x7ff76719afb8?, 0x4000054f08, 0x1a9058396cf20?)
...
        os/exec.(*Cmd).Start.func2(0x400002eab1?)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:724 +0x34 fp=0x40003abfb0 sp=0x40003abf40 pc=0x7ff766653e24
        os/exec.(*Cmd).Start.gowrap1()
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:736 +0x30 fp=0x40003abfd0 sp=0x40003abfb0 pc=0x7ff766653db0
        runtime.goexit({})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1223 +0x4 fp=0x40003abfd0 sp=0x40003abfd0 pc=0x7ff7664eca44
        created by os/exec.(*Cmd).Start in goroutine 528
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:723 +0x824
    script_test.go:159: FAIL: testdata\script\devnull.txt:7: go test -o=NUL -c: exit status 2
--- FAIL: TestScript/devnull (1.99s)

2024-05-22 02:25 gotip-windows-arm64 go@bf0bbd53 [build] (log)

[I2024-05-22T03:13:53.951657Z 1416 0 sink.go:276] SinkServer: warm-up started
[I2024-05-22T03:13:53.951657Z 1416 0 sink.go:346] SinkServer: starting HTTP server...
[I2024-05-22T03:13:53.953821Z 1416 0 sink.go:281] SinkServer: warm-up ended
[I2024-05-22T03:13:53.954500Z 1416 0 cmd_stream.go:475] rdb-stream: starting the test command - ["C:\\Users\\swarming\\.swarming\\w\\ir\\cache\\tools\\bin\\result_adapter.exe" "go" "-v=false" "--" "C:\\Users\\swarming\\.swarming\\w\\ir\\x\\w\\goroot\\bin\\go" "tool" "dist" "test" "-json"]
# internal/chacha8rand
fatal error: runtime: cannot allocate memory

goroutine 1 gp=0x400004a000 m=0 mp=0x7ff7a3ca3580 [running, locked to thread]:
runtime.throw({0x7ff7a3409e00?, 0x7ff7a293f0d0?})
	runtime/panic.go:1047 +0x38 fp=0x400015bbe0 sp=0x400015bbb0 pc=0x7ff7a294fc88
...
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff7a33f2062?, 0x40002df000?})
	runtime/panic.go:1047 +0x38 fp=0xc332bffd60 sp=0xc332bffd30 pc=0x7ff7a294fc88
runtime.sysUsedOS(0x4000200000, 0x1ea000)
	runtime/mem_windows.go:83 +0x178 fp=0xc332bffdc0 sp=0xc332bffd60 pc=0x7ff7a28ecfc8
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff7a3cc4900, 0xf5, 0x0, 0x0)
...
go tool dist: Failed: exit status 1
[I2024-05-22T03:13:58.885407Z 1416 0 cmd_stream.go:471] rdb-stream: the test process terminated
[I2024-05-22T03:13:58.885407Z 1416 0 sink.go:371] SinkServer: shutdown started
[I2024-05-22T03:13:58.885960Z 1416 0 sink.go:349] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-05-22T03:13:58.885960Z 1416 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-05-22T03:13:58.885960Z 1416 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-05-22T03:13:58.885960Z 1416 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-05-22T03:13:58.885960Z 1416 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-05-22T03:13:58.885960Z 1416 0 sink.go:374] SinkServer: shutdown completed successfully
[I2024-05-22T03:13:58.885960Z 1416 0 cmd_stream.go:403] rdb-stream: exiting with 1

2024-05-22 09:20 gotip-windows-arm64 go@c96159c2 make.bat (log)

Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.20.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
# cmd/compile/internal/ssa [cmd/compile]
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
...
	cmd/compile/internal/ssagen/pgen.go:302 +0x70 fp=0x40237e5f60 sp=0x40237e5e90 pc=0x7ff61da78cb0
cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
	cmd/compile/internal/gc/compile.go:183 +0x40 fp=0x40237e5fa0 sp=0x40237e5f60 pc=0x7ff61dc26a70
cmd/compile/internal/gc.compileFunctions.func3.1()
	cmd/compile/internal/gc/compile.go:165 +0x3c fp=0x40237e5fd0 sp=0x40237e5fa0 pc=0x7ff61dc26ddc
runtime.goexit({})
	runtime/asm_arm64.s:1223 +0x4 fp=0x40237e5fd0 sp=0x40237e5fd0 pc=0x7ff61d32cbe4
created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 75
	cmd/compile/internal/gc/compile.go:164 +0x1e0
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install -a cmd/asm cmd/cgo cmd/compile cmd/link cmd/preprofile: exit status 1

2024-05-22 09:57 gotip-linux-amd64-longtest-race go@df4e4936 net (log)

FAIL	net	1.350s

2024-05-22 09:57 gotip-linux-amd64-longtest-race go@df4e4936 net (log)

goos: linux
goarch: amd64
pkg: net
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
PASS
ok  	net	90.158s

2024-05-22 09:57 gotip-linux-amd64-longtest-race go@df4e4936 net [PASS] (log)

FAIL	net	1.350s

— watchflakes

gopherbot · 2024-05-24T13:41:16Z

Change https://go.dev/cl/588235 mentions this issue: internal/runtime/exithook: make safe for concurrent os.Exit

Real programs can call os.Exit concurrently from multiple goroutines. Make internal/runtime/exithook not crash in that case. The throw on panic also now runs in the deferred context, so that we will see the full stack trace that led to the panic. That should give us more visibility into the flaky failures on bugs #55167 and #56197 as well. Fixes #67631. Change-Id: Iefdf71b3a3b52a793ca88d89a9c270eb50ece094 Reviewed-on: https://go-review.googlesource.com/c/go/+/588235 Reviewed-by: Than McIntosh <[email protected]> LUCI-TryBot-Result: Go LUCI <[email protected]> Auto-Submit: Russ Cox <[email protected]>

rsc added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Sep 20, 2022

rsc added this to Test Flakes Sep 20, 2022

gopherbot added the compiler/runtime Issues related to the Go compiler and/or runtime. label Sep 20, 2022

rsc moved this to Active in Test Flakes Sep 20, 2022

rsc changed the title ~~runtime: flaky corruption in tests~~ runtime: corruption in tests Sep 20, 2022

mknyszek added this to Go Compiler / Runtime Sep 28, 2022

mknyszek assigned cherrymui Sep 28, 2022

mknyszek added this to the Go1.20 milestone Sep 28, 2022

mknyszek moved this to Todo in Go Compiler / Runtime Sep 28, 2022

rsc closed this as completed Sep 28, 2022

Repository owner moved this from Todo to Done in Go Compiler / Runtime Sep 28, 2022

Repository owner moved this from Active to Done in Test Flakes Sep 28, 2022

gopherbot reopened this Oct 19, 2022

Repository owner moved this from Done to In Progress in Go Compiler / Runtime Oct 19, 2022

bcmills mentioned this issue Nov 28, 2022

runtime: TestRecoverBeforePanicAfterGoexit2 failures #56964

Open

gopherbot modified the milestones: Go1.23, Go1.24 Aug 13, 2024

runtime: corruption in tests #55167

runtime: corruption in tests #55167

Comments

rsc commented Sep 20, 2022 • edited by cherrymui Loading

gopherbot commented Sep 20, 2022 • edited Loading

gopherbot commented Sep 21, 2022

rsc commented Sep 28, 2022 • edited Loading

gopherbot commented Oct 4, 2022

cherrymui commented Oct 4, 2022

gopherbot commented Oct 13, 2022

gopherbot commented Oct 19, 2022

gopherbot commented Nov 4, 2022

aclements commented Nov 8, 2022

gopherbot commented Nov 17, 2022

gopherbot commented Nov 21, 2022

gopherbot commented Nov 28, 2022

bcmills commented Nov 28, 2022

cherrymui commented Nov 28, 2022

gopherbot commented Dec 8, 2022

gopherbot commented Apr 23, 2024

gopherbot commented Apr 25, 2024

gopherbot commented Apr 27, 2024

gopherbot commented Apr 29, 2024

gopherbot commented May 3, 2024

gopherbot commented May 6, 2024

gopherbot commented May 6, 2024

gopherbot commented May 8, 2024

gopherbot commented May 8, 2024

gopherbot commented May 10, 2024

gopherbot commented May 13, 2024

gopherbot commented May 13, 2024

gopherbot commented May 14, 2024

gopherbot commented May 14, 2024

gopherbot commented May 14, 2024

gopherbot commented May 15, 2024

gopherbot commented May 15, 2024

gopherbot commented May 16, 2024

gopherbot commented May 16, 2024

gopherbot commented May 17, 2024

gopherbot commented May 18, 2024

gopherbot commented May 18, 2024

gopherbot commented May 18, 2024

gopherbot commented May 18, 2024

gopherbot commented May 21, 2024

gopherbot commented May 23, 2024

gopherbot commented May 24, 2024

rsc commented Sep 20, 2022 •

edited by cherrymui

Loading

gopherbot commented Sep 20, 2022 •

edited

Loading

rsc commented Sep 28, 2022 •

edited

Loading