Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test: Test failures on ppc64.* #60148

Closed
gopherbot opened this issue May 12, 2023 · 39 comments
Closed

test: Test failures on ppc64.* #60148

gopherbot opened this issue May 12, 2023 · 39 comments
Labels
arch-ppc64x Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Milestone
Backlog

Comments

@gopherbot
Copy link
Contributor

gopherbot commented May 12, 2023 •
edited by bcmills
Loading 

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64` && date < "2023-06-01"

Issue created automatically to collect these failures.

Example (log):

PASS
PASS
PASS
PASS
PASS
PASS
--- FAIL: Test (0.01s)
    --- FAIL: Test/fixedbugs/issue59334.go (6.03s)
        testdir_test.go:117: exit status 1
            runtime: /workdir/go/pkg/tool/linux_ppc64/compile: signal: killed

go tool dist: Failed: exit status 1

— watchflakes
@gopherbot gopherbot added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label May 12, 2023
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test"
2023-05-12 12:34 linux-ppc64-sid-power10 go@b6c75c5f test.Test (log) 
PASS
PASS
PASS
PASS
PASS
PASS
--- FAIL: Test (0.01s)
    --- FAIL: Test/fixedbugs/issue59334.go (6.03s)
        testdir_test.go:117: exit status 1
            runtime: /workdir/go/pkg/tool/linux_ppc64/compile: signal: killed

go tool dist: Failed: exit status 1

— watchflakes

@bcmills bcmills added the compiler/runtime Issues related to the Go compiler and/or runtime. label May 12, 2023
@bcmills
Copy link
Contributor

bcmills commented May 12, 2023

(attn @golang/ppc64; CC @golang/compiler)

@pmur
Copy link
Contributor

pmur commented May 12, 2023

I think that is an OOM on our builders with newer kernels. The linux ppc64/p9,ppc64/p10,ppc64le/p10 VMs running a newer kernel are slowly leaking memory each time a container starts and stops.

I've poked at it a few times, but haven't been able to figure what is leaking. Something is holding onto percpu memory in the kernel, but not on every container cycling.

I've rebooted the ppc64/p10 VM.

@gopherbot

This comment was marked as off-topic.

Sign in to view
@bcmills bcmills changed the title test: Test failures test: Test failures on ppc64.* May 16, 2023
@mknyszek
Copy link
Contributor

From the last message, it seems like this might be builder-related? Tentatively dropping this from the compiler/runtime queue.

@mknyszek mknyszek added Builders x/build issues (builders, bots, dashboards) and removed compiler/runtime Issues related to the Go compiler and/or runtime. labels May 17, 2023
@mknyszek mknyszek added this to the Backlog milestone May 17, 2023
@mknyszek mknyszek mentioned this issue May 17, 2023
Closed
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-17 21:53 linux-ppc64-sid-buildlet go@c426c870 test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/index0.go (2.15s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go2064975669/001/tmp__.go:2342:7: internal compiler error: 'main.func1903': local variable with class Pxxx unimplemented

            goroutine 1600 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x13936f8?}, {0xc005de2de0, 0x30}, {0xc0043a1d20, 0x2, 0x2})
            	cmd/compile/internal/base/print.go:234 +0x270
            cmd/compile/internal/base.Fatalf(...)
            	cmd/compile/internal/base/print.go:203
            cmd/compile/internal/ssagen.(*ssafn).Fatalf(0x662580?, {0xc0?, 0x5d72cb8?}, {0x982db6, 0x2a}, {0xc000badc40, 0x1, 0x100000000000000?})
            	cmd/compile/internal/ssagen/ssa.go:7896 +0x1a0
            cmd/compile/internal/ssagen.(*state).Fatalf(0xc0043a1ce0?, {0x982db6?, 0xc001393a88?}, {0xc000badc40?, 0xbf00000000000000?, 0x0?})
            	cmd/compile/internal/ssagen/ssa.go:932 +0xb8
            cmd/compile/internal/ssagen.buildssa(0xc0031f9ce0, 0x0)
            	cmd/compile/internal/ssagen/ssa.go:479 +0x1a70
            cmd/compile/internal/ssagen.Compile(0xc0031f9ce0, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 7
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-18 01:40 linux-ppc64-sid-power10 go@6ed84743 test.Test (log) 
--- FAIL: Test (0.01s)
    --- FAIL: Test/clearfat.go (2.15s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            runtime: pointer 0xc004000000 to unallocated span span.base()=0xc004000000 span.limit=0xc004002000 span.state=0
            fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

            runtime stack:
            runtime.throw({0x98c4f3?, 0xc0041fd800?})
            	runtime/panic.go:1077 +0x40 fp=0xc000053e90 sp=0xc000053e50 pc=0x58e30
...
            cmd/compile/internal/ssagen.Compile(0xc002d2d340, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:197 +0x27c fp=0xc0074c3f30 sp=0xc0074c3d60 pc=0x6602fc
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc0074c3f80 sp=0xc0074c3f30 pc=0x860e8c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc0074c3fc0 sp=0xc0074c3f80 pc=0x861278
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0074c3fc0 sp=0xc0074c3fc0 pc=0x95224
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 6
            	cmd/compile/internal/gc/compile.go:165 +0x20c
2023-05-18 09:16 linux-ppc64-sid-power10 go@774f6022 test.Test (log) 
--- FAIL: Test (0.01s)
    --- FAIL: Test/index0.go (1.48s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go580999706/001/tmp__.go:2490:7: internal compiler error: 'main.func2036': local variable with class Pxxx unimplemented

            goroutine 550 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x51b6f8?}, {0xc004a1df80, 0x30}, {0xc004c93e80, 0x2, 0x2})
            	cmd/compile/internal/base/print.go:234 +0x250
            cmd/compile/internal/base.Fatalf(...)
            	cmd/compile/internal/base/print.go:203
            cmd/compile/internal/ssagen.(*ssafn).Fatalf(0x6682cc?, {0xc0?, 0x4ce6228?}, {0x982d9e, 0x2a}, {0xc000f56a90, 0x1, 0x100000000000000?})
            	cmd/compile/internal/ssagen/ssa.go:7896 +0x1a0
            cmd/compile/internal/ssagen.(*state).Fatalf(0xc004c93e60?, {0x982d9e?, 0xc00051ba88?}, {0xc000f56a90?, 0x0?, 0x0?})
            	cmd/compile/internal/ssagen/ssa.go:932 +0xb8
            cmd/compile/internal/ssagen.buildssa(0xc0032e9600, 0x1)
            	cmd/compile/internal/ssagen/ssa.go:479 +0x195c
            cmd/compile/internal/ssagen.Compile(0xc0032e9600, 0xd?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0xc0004b5e90?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 5
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-23 19:40 linux-ppc64le-buildlet go@c0b860ba test.Test (log) 
--- FAIL: Test (0.03s)
    --- FAIL: Test/fixedbugs/issue20014.go (3.82s)
        testdir_test.go:132: exit status 1
            # runtime
            runtime: marked free object in span 0x702d80c107e8, elemsize=80 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
            0xc003c3c000 alloc unmarked
            0xc003c3c050 alloc unmarked
            0xc003c3c0a0 alloc marked  
            0xc003c3c0f0 alloc marked  
            0xc003c3c140 alloc marked  
...
            fatal error: found pointer to free object

            goroutine 3 [running]:
            runtime.throw({0x9779d8?, 0xc003c3dd10?})
            	runtime/panic.go:1077 +0x40 fp=0xc000045558 sp=0xc000045518 pc=0x59140
            runtime.(*mspan).reportZombies(0x702d80c107e8)
            	runtime/mgcsweep.go:861 +0x30c fp=0xc0000455e8 sp=0xc000045558 pc=0x430fc
            runtime.(*sweepLocked).sweep(0x103b340?, 0x0)
            	runtime/mgcsweep.go:644 +0xe2c fp=0xc000045708 sp=0xc0000455e8 pc=0x4290c
            runtime.sweepone(...)
            	runtime/mgcsweep.go:393
            runtime.bgsweep(0x0?)
            	runtime/mgcsweep.go:301 +0x1e4 fp=0xc000045798 sp=0xc000045708 pc=0x40d94
            runtime.gcenable.func1()
            	runtime/mgc.go:178 +0x4c fp=0xc0000457c0 sp=0xc000045798 pc=0x3317c
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0000457c0 sp=0xc0000457c0 pc=0x94f64
            created by runtime.gcenable in goroutine 1
            	runtime/mgc.go:178 +0x7c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-23 19:17 linux-ppc64-sid-buildlet go@131267f1 test.Test (log) 
--- FAIL: Test (0.11s)
    --- FAIL: Test/index0.go (3.39s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go112688166/001/tmp__.go:1574:5: internal compiler error: 'main.func1760': unhandled stmt XXX

            goroutine 1768 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x8c1268?}, {0xc0008c1240, 0x17}, {0xc006cb19c0, 0x2, 0x2})
...
            cmd/compile/internal/ssagen.buildssa(0xc0030cb600, 0x1)
            	cmd/compile/internal/ssagen/ssa.go:548 +0x24e0
            cmd/compile/internal/ssagen.Compile(0xc0030cb600, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0xc000879230?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 24
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-23 20:22 linux-ppc64-sid-buildlet go@64c95d24 test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/fixedbugs/issue20014.go (3.49s)
        testdir_test.go:132: exit status 1
            # runtime
            runtime: marked free object in span 0x7fff6b24c620, elemsize=24 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
            0xc001c92000 free  unmarked
            0xc001c92018 free  unmarked
            0xc001c92030 free  unmarked
            0xc001c92048 free  unmarked
            0xc001c92060 free  unmarked
...
            fatal error: found pointer to free object

            goroutine 3 [running]:
            runtime.throw({0x977c4b?, 0xc001c92408?})
            	runtime/panic.go:1077 +0x40 fp=0xc000045558 sp=0xc000045518 pc=0x58f10
            runtime.(*mspan).reportZombies(0x7fff6b24c620)
            	runtime/mgcsweep.go:861 +0x30c fp=0xc0000455e8 sp=0xc000045558 pc=0x42dcc
            runtime.(*sweepLocked).sweep(0x103b3e0?, 0x0)
            	runtime/mgcsweep.go:644 +0xe2c fp=0xc000045708 sp=0xc0000455e8 pc=0x425dc
            runtime.sweepone(...)
            	runtime/mgcsweep.go:393
            runtime.bgsweep(0x0?)
            	runtime/mgcsweep.go:301 +0x1e4 fp=0xc000045798 sp=0xc000045708 pc=0x40a64
            runtime.gcenable.func1()
            	runtime/mgc.go:178 +0x4c fp=0xc0000457c0 sp=0xc000045798 pc=0x32e0c
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0000457c0 sp=0xc0000457c0 pc=0x94cb4
            created by runtime.gcenable in goroutine 1
            	runtime/mgc.go:178 +0x7c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-23 19:24 linux-ppc64le-buildlet go@6f13d0bf test.Test (log) 
--- FAIL: Test (0.03s)
    --- FAIL: Test/fixedbugs/issue16037_run.go (4.00s)
        testdir_test.go:132: exit status 1
            2023/05/23 21:59:17 build failed: exit status 1
            # command-line-arguments
            panic: runtime error: index out of range [61] with length 3

            goroutine 538 [running]:
            panic({0x928e40?, 0xc0009e4060?})
            	runtime/panic.go:1017 +0x448 fp=0xc001a95080 sp=0xc001a94fc0 pc=0x58cf8
...
            cmd/compile/internal/ssagen.Compile(0xc0024e66e0, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc001a95f30 sp=0xc001a95d60 pc=0x653ba8
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc001a95f80 sp=0xc001a95f30 pc=0x859bdc
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc001a95fc0 sp=0xc001a95f80 pc=0x859fa8
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc001a95fc0 sp=0xc001a95fc0 pc=0x94ed4
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 23
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-23 21:46 linux-ppc64-sid-buildlet go@26f25692 test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/index0.go (1.95s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go1819078244/001/tmp__.go:2369:7: internal compiler error: 'main.func1930': local variable with class Pxxx unimplemented

            goroutine 1607 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x7356f8?}, {0xc00624b560, 0x30}, {0xc0063459a0, 0x2, 0x2})
            	cmd/compile/internal/base/print.go:234 +0x270
            cmd/compile/internal/base.Fatalf(...)
            	cmd/compile/internal/base/print.go:203
            cmd/compile/internal/ssagen.(*ssafn).Fatalf(0x665a00?, {0xc0?, 0x64d0cb8?}, {0x983a22, 0x2a}, {0xc000e03c00, 0x1, 0x100000000000000?})
            	cmd/compile/internal/ssagen/ssa.go:7985 +0x1a0
            cmd/compile/internal/ssagen.(*state).Fatalf(0xc006345980?, {0x983a22?, 0xc000735a88?}, {0xc000e03c00?, 0xc00037aae0?, 0xc00037aae0?})
            	cmd/compile/internal/ssagen/ssa.go:932 +0xb8
            cmd/compile/internal/ssagen.buildssa(0xc0031ea2c0, 0x0)
            	cmd/compile/internal/ssagen/ssa.go:479 +0x1a70
            cmd/compile/internal/ssagen.Compile(0xc0031ea2c0, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 10
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-23 19:15 linux-ppc64le-power10osu go@8b51eb51 test.Test (log) 
--- FAIL: Test (0.03s)
    --- FAIL: Test/fixedbugs/bug513.go (5.74s)
        testdir_test.go:132: exit status 1
            # runtime
            runtime: marked free object in span 0x77050932fbf0, elemsize=160 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
            0xc0041e6000 alloc marked  
            0xc0041e60a0 alloc marked  
            0xc0041e6140 alloc marked  
            0xc0041e61e0 alloc marked  
            0xc0041e6280 alloc marked  
...
            fatal error: found pointer to free object

            goroutine 3 [running]:
            runtime.throw({0x97793b?, 0xc0041e66e0?})
            	runtime/panic.go:1077 +0x40 fp=0xc000043558 sp=0xc000043518 pc=0x58ff0
            runtime.(*mspan).reportZombies(0x77050932fbf0)
            	runtime/mgcsweep.go:861 +0x304 fp=0xc0000435e8 sp=0xc000043558 pc=0x42e84
            runtime.(*sweepLocked).sweep(0x102b2c0?, 0x0)
            	runtime/mgcsweep.go:644 +0xddc fp=0xc000043708 sp=0xc0000435e8 pc=0x4269c
            runtime.sweepone(...)
            	runtime/mgcsweep.go:393
            runtime.bgsweep(0x0?)
            	runtime/mgcsweep.go:301 +0x1d4 fp=0xc000043798 sp=0xc000043708 pc=0x40b94
            runtime.gcenable.func1()
            	runtime/mgc.go:178 +0x4c fp=0xc0000437c0 sp=0xc000043798 pc=0x32a7c
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0000437c0 sp=0xc0000437c0 pc=0x95664
            created by runtime.gcenable in goroutine 1
            	runtime/mgc.go:178 +0x78

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-23 21:46 linux-ppc64le-buildlet go@26f25692 test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/fixedbugs/issue59334.go (3.56s)
        testdir_test.go:132: exit status 1
            # runtime
            panic: runtime error: invalid memory address or nil pointer dereference
            [signal SIGSEGV: segmentation violation code=0x1 addr=0x12 pc=0x1e8708]

            goroutine 758 [running]:
            panic({0x8e5040?, 0xf75b90?})
            	runtime/panic.go:1017 +0x448 fp=0xc00008eaf8 sp=0xc00008ea38 pc=0x58d88
...
            cmd/compile/internal/ssagen.Compile(0xc00233ab00, 0xc0005e9810?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc00008ff30 sp=0xc00008fd60 pc=0x653ba8
            cmd/compile/internal/gc.compileFunctions.func5.1(0xc0005e9c00?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc00008ff80 sp=0xc00008ff30 pc=0x859d7c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc00008ffc0 sp=0xc00008ff80 pc=0x85a148
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc00008ffc0 sp=0xc00008ffc0 pc=0x94f64
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 166
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-23 23:33 linux-ppc64-sid-power10 go@0df68124 test.Test (log) 
--- FAIL: Test (0.01s)
    --- FAIL: Test/fixedbugs/issue20014.go (3.07s)
        testdir_test.go:132: exit status 1
            # runtime
            runtime: marked free object in span 0x7fff7285a020, elemsize=24 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
            0xc000cb8000 alloc marked  
            0xc000cb8018 alloc marked  
            0xc000cb8030 alloc marked  
            0xc000cb8048 free  unmarked
            0xc000cb8060 free  unmarked
...
            fatal error: found pointer to free object

            goroutine 3 [running]:
            runtime.throw({0x977da3?, 0xc000cb9788?})
            	runtime/panic.go:1077 +0x40 fp=0xc000045558 sp=0xc000045518 pc=0x58eb0
            runtime.(*mspan).reportZombies(0x7fff7285a020)
            	runtime/mgcsweep.go:861 +0x304 fp=0xc0000455e8 sp=0xc000045558 pc=0x42a44
            runtime.(*sweepLocked).sweep(0x103b3e0?, 0x0)
            	runtime/mgcsweep.go:644 +0xddc fp=0xc000045708 sp=0xc0000455e8 pc=0x4225c
            runtime.sweepone(...)
            	runtime/mgcsweep.go:393
            runtime.bgsweep(0x0?)
            	runtime/mgcsweep.go:301 +0x1d4 fp=0xc000045798 sp=0xc000045708 pc=0x40754
            runtime.gcenable.func1()
            	runtime/mgc.go:178 +0x4c fp=0xc0000457c0 sp=0xc000045798 pc=0x3277c
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0000457c0 sp=0xc0000457c0 pc=0x955e4
            created by runtime.gcenable in goroutine 1
            	runtime/mgc.go:178 +0x78

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-24 04:06 linux-ppc64le-power9osu go@5b93af7f test.Test (log) 
--- FAIL: Test (0.03s)
    --- FAIL: Test/fixedbugs/issue59334.go (4.72s)
        testdir_test.go:132: exit status 1
            # runtime
            ../src/runtime/hash64.go:61:14: internal compiler error: Orig nil
            .   XXX # %!v(PANIC=Format method: runtime error: index out of range [33686274] with length 7908)
            ../src/runtime/hash64.go:61:14: internal compiler error: Orig returned nil

            goroutine 2852 [running]:
            runtime/debug.Stack()
...
            cmd/compile/internal/ssagen.buildssa(0xc000698f20, 0x2)
            	cmd/compile/internal/ssagen/ssa.go:548 +0x24a0
            cmd/compile/internal/ssagen.Compile(0xc000698f20, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 158
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-24 19:23 linux-ppc64-sid-buildlet go@a4772a1a test.Test (log) 
--- FAIL: Test (0.04s)
    --- FAIL: Test/codegen/copy.go (9.85s)
        testdir_test.go:732: linux/ppc64/power9 
             # runtime
            :2285:38: internal compiler error: 'copyValues': unhandled expr XXX

            goroutine 659 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x320f958?}, {0xc00320f930, 0x17}, {0xc004d397e0, 0x2, 0x2})
...
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 166
            	cmd/compile/internal/gc/compile.go:165 +0x20c


        testdir_test.go:132: exit status 1

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-24 18:58 linux-ppc64le-buildlet go@2a8969cb test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/index0.go (1.60s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            runtime: marked free object in span 0x7c63ae2f9e08, elemsize=80 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
            0xc002f60000 alloc marked  
            0xc002f60050 alloc marked  
            0xc002f600a0 free  unmarked
            0xc002f600f0 alloc marked  
            0xc002f60140 alloc marked  
...
            fatal error: found pointer to free object

            goroutine 3 [running]:
            runtime.throw({0x977ebf?, 0xc002f60fa0?})
            	runtime/panic.go:1077 +0x40 fp=0xc000043558 sp=0xc000043518 pc=0x591c0
            runtime.(*mspan).reportZombies(0x7c63ae2f9e08)
            	runtime/mgcsweep.go:861 +0x30c fp=0xc0000435e8 sp=0xc000043558 pc=0x4317c
            runtime.(*sweepLocked).sweep(0x103b7e0?, 0x0)
            	runtime/mgcsweep.go:644 +0xe2c fp=0xc000043708 sp=0xc0000435e8 pc=0x4298c
            runtime.sweepone(...)
            	runtime/mgcsweep.go:393
            runtime.bgsweep(0x0?)
            	runtime/mgcsweep.go:301 +0x1e4 fp=0xc000043798 sp=0xc000043708 pc=0x40e14
            runtime.gcenable.func1()
            	runtime/mgc.go:178 +0x4c fp=0xc0000437c0 sp=0xc000043798 pc=0x331fc
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0000437c0 sp=0xc0000437c0 pc=0x94f94
            created by runtime.gcenable in goroutine 1
            	runtime/mgc.go:178 +0x7c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-24 20:19 linux-ppc64-sid-power10 go@a6fb97b6 test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/index0.go (1.33s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go3308625416/001/tmp__.go:1574:5: internal compiler error: 'main.func1131': unhandled stmt XXX

            goroutine 340 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x3f59268?}, {0xc003f59240, 0x17}, {0xc003c01160, 0x2, 0x2})
...
            cmd/compile/internal/ssagen.buildssa(0xc002bc2b00, 0x2)
            	cmd/compile/internal/ssagen/ssa.go:548 +0x2374
            cmd/compile/internal/ssagen.Compile(0xc002bc2b00, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 7
            	cmd/compile/internal/gc/compile.go:165 +0x20c
2023-05-24 20:23 linux-ppc64-sid-buildlet go@9a49b26b test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/fixedbugs/issue16037_run.go (4.55s)
        testdir_test.go:132: exit status 1
            2023/05/24 20:41:30 build failed: exit status 1
            # command-line-arguments
            panic: runtime error: invalid memory address or nil pointer dereference
            [signal SIGSEGV: segmentation violation code=0x1 addr=0x50 pc=0x66b9e4]

            goroutine 3028 [running]:
            panic({0x8e5200?, 0xf75c70?})
...
            cmd/compile/internal/ssagen.Compile(0xc002cf8580, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc00008df30 sp=0xc00008dd60 pc=0x65d438
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc00008df80 sp=0xc00008df30 pc=0x86536c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc00008dfc0 sp=0xc00008df80 pc=0x865738
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc00008dfc0 sp=0xc00008dfc0 pc=0x94ce4
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 9
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-24 21:17 linux-ppc64le-buildlet go@78143d96 test.Test (log) 
--- FAIL: Test (0.04s)
    --- FAIL: Test/index0.go (2.63s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            panic: runtime error: index out of range [19645312] with length 4028

            goroutine 1526 [running]:
            panic({0x9292e0?, 0xc005d00948?})
            	runtime/panic.go:1017 +0x448 fp=0xc000055080 sp=0xc000054fc0 pc=0x58e08
            runtime.goPanicIndex(0x12bc380, 0xfbc)
...
            cmd/compile/internal/ssagen.Compile(0xc003398420, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc000055f30 sp=0xc000055d60 pc=0x653d98
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc000055f80 sp=0xc000055f30 pc=0x85b0ec
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc000055fc0 sp=0xc000055f80 pc=0x85b4b8
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc000055fc0 sp=0xc000055fc0 pc=0x94f94
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 11
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@bcmills bcmills mentioned this issue May 24, 2023
Closed
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-24 22:39 linux-ppc64le-buildlet go@79a8997a test.Test (log) 
--- FAIL: Test (0.04s)
    --- FAIL: Test/fixedbugs/bug513.go (6.18s)
        testdir_test.go:132: exit status 1
            # runtime
            panic: runtime error: index out of range [16874517] with length 7985 [recovered]
            	panic: runtime error: index out of range [16874517] with length 7985

            goroutine 1 [running]:
            panic({0x9292e0?, 0xc0061cced0?})
            	runtime/panic.go:1017 +0x448 fp=0xc007906640 sp=0xc007906580 pc=0x58ea8
...
            cmd/compile/internal/gc.compileFunctions()
            	cmd/compile/internal/gc/compile.go:194 +0x220 fp=0xc007907968 sp=0xc0079078e8 pc=0x85bdf0
            cmd/compile/internal/gc.Main(0x999a20)
            	cmd/compile/internal/gc/main.go:344 +0x1764 fp=0xc007907ea8 sp=0xc007907968 pc=0x85e144
            main.main()
            	cmd/compile/main.go:57 +0x134 fp=0xc007907f18 sp=0xc007907ea8 pc=0x883a74
            runtime.main()
            	runtime/proc.go:267 +0x348 fp=0xc007907fc0 sp=0xc007907f18 pc=0x5beb8
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc007907fc0 sp=0xc007907fc0 pc=0x95034

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-24 22:39 linux-ppc64le-power10osu go@79a8997a test.Test (log) 
--- FAIL: Test (0.03s)
    --- FAIL: Test/index0.go (2.91s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            panic: runtime error: index out of range [66602816] with length 4028

            goroutine 479 [running]:
            panic({0x9292e0?, 0xc003c04f60?})
            	runtime/panic.go:1017 +0x434 fp=0xc001dab080 sp=0xc001daafc0 pc=0x58e34
            runtime.goPanicIndex(0x3f84740, 0xfbc)
...
            cmd/compile/internal/ssagen.Compile(0xc00300e2c0, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc001dabf30 sp=0xc001dabd60 pc=0x65ad48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc001dabf80 sp=0xc001dabf30 pc=0x86064c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc001dabfc0 sp=0xc001dabf80 pc=0x860a38
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc001dabfc0 sp=0xc001dabfc0 pc=0x95924
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 9
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-25 00:12 linux-ppc64le-power10osu go@c5c21845 test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/index0.go (2.53s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            panic: runtime error: index out of range [8023680] with length 4028

            goroutine 1772 [running]:
            panic({0x9292e0?, 0xc006a7dbc0?})
            	runtime/panic.go:1017 +0x434 fp=0xc0007df080 sp=0xc0007defc0 pc=0x58e34
            runtime.goPanicIndex(0x7a6e80, 0xfbc)
...
            cmd/compile/internal/ssagen.Compile(0xc00303fce0, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc0007dff30 sp=0xc0007dfd60 pc=0x65ad48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc0007dff80 sp=0xc0007dff30 pc=0x8606cc
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc0007dffc0 sp=0xc0007dff80 pc=0x860ab8
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0007dffc0 sp=0xc0007dffc0 pc=0x95924
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 12
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-25 01:01 linux-ppc64-sid-power10 go@20e08fe6 test.Test (log) 
--- FAIL: Test (0.01s)
    --- FAIL: Test/index0.go (3.12s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go3895040330/001/tmp__.go:1996:7: internal compiler error: 'main.func1602': local variable with class PFUNC unimplemented

            goroutine 1922 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x51c16f8?}, {0xc0077069c0, 0x30}, {0xc006b5f420, 0x2, 0x2})
            	cmd/compile/internal/base/print.go:230 +0x250
            cmd/compile/internal/base.Fatalf(...)
            	cmd/compile/internal/base/print.go:199
            cmd/compile/internal/ssagen.(*ssafn).Fatalf(0x66c50c?, {0xc0?, 0x77335a8?}, {0x993fb3, 0x2a}, {0xc007742650, 0x1, 0x100000000000000?})
            	cmd/compile/internal/ssagen/ssa.go:7985 +0x1a0
            cmd/compile/internal/ssagen.(*state).Fatalf(0xc006b5f400?, {0x993fb3?, 0xc0051c1a88?}, {0xc007742650?, 0x0?, 0x0?})
            	cmd/compile/internal/ssagen/ssa.go:932 +0xb8
            cmd/compile/internal/ssagen.buildssa(0xc002f91a20, 0x1)
            	cmd/compile/internal/ssagen/ssa.go:479 +0x195c
            cmd/compile/internal/ssagen.Compile(0xc002f91a20, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 5
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-25 15:34 linux-ppc64-sid-power10 go@f4086d36 test.Test (log) 
--- FAIL: Test (0.01s)
    --- FAIL: Test/index0.go (2.10s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go3269865608/001/tmp__.go:1574:5: internal compiler error: 'main.func2308': unhandled stmt XXX

            goroutine 1210 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x1865268?}, {0xc001865240, 0x17}, {0xc00572ffa0, 0x2, 0x2})
...
            cmd/compile/internal/ssagen.buildssa(0xc0034dd080, 0x1)
            	cmd/compile/internal/ssagen/ssa.go:548 +0x2374
            cmd/compile/internal/ssagen.Compile(0xc0034dd080, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 5
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-25 17:51 linux-ppc64le-power10osu go@4c028edf test.Test (log) 
--- FAIL: Test (0.03s)
    --- FAIL: Test/index0.go (2.13s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go2781464518/001/tmp__.go:3049:7: internal compiler error: 'main.func2520': local variable with class Class(164) unimplemented

            goroutine 989 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xab6f8?, 0xc0?}, {0xc00116ed80, 0x30}, {0xc0026d4a20, 0x2, 0x2})
            	cmd/compile/internal/base/print.go:230 +0x250
            cmd/compile/internal/base.Fatalf(...)
            	cmd/compile/internal/base/print.go:199
            cmd/compile/internal/ssagen.(*ssafn).Fatalf(0x662e78?, {0xe85dc8?, 0xc0?}, {0x983d80, 0x2a}, {0xc00354ec60, 0x1, 0x1?})
            	cmd/compile/internal/ssagen/ssa.go:7985 +0x1a0
            cmd/compile/internal/ssagen.(*state).Fatalf(0xc0026d49e0?, {0x983d80?, 0xc0000aba88?}, {0xc00354ec60?, 0x0?, 0x0?})
            	cmd/compile/internal/ssagen/ssa.go:932 +0xb8
            cmd/compile/internal/ssagen.buildssa(0xc003625760, 0x0)
            	cmd/compile/internal/ssagen/ssa.go:479 +0x1944
            cmd/compile/internal/ssagen.Compile(0xc003625760, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 9
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-25 22:02 linux-ppc64le-power10osu go@f0e356a0 test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/index0.go (2.04s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            runtime: marked free object in span 0x70aff99dbce0, elemsize=80 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
            0xc002ff6000 alloc marked  
            0xc002ff6050 free  unmarked
            0xc002ff60a0 alloc marked  
            0xc002ff60f0 alloc marked  
            0xc002ff6140 free  unmarked
...
            fatal error: found pointer to free object

            goroutine 3 [running]:
            runtime.throw({0x977fca?, 0xc002ff7720?})
            	runtime/panic.go:1077 +0x40 fp=0xc000043558 sp=0xc000043518 pc=0x591f0
            runtime.(*mspan).reportZombies(0x70aff99dbce0)
            	runtime/mgcsweep.go:861 +0x304 fp=0xc0000435e8 sp=0xc000043558 pc=0x42ec4
            runtime.(*sweepLocked).sweep(0x103b8a0?, 0x0)
            	runtime/mgcsweep.go:644 +0xddc fp=0xc000043708 sp=0xc0000435e8 pc=0x426dc
            runtime.sweepone(...)
            	runtime/mgcsweep.go:393
            runtime.bgsweep(0x0?)
            	runtime/mgcsweep.go:301 +0x1d4 fp=0xc000043798 sp=0xc000043708 pc=0x40bd4
            runtime.gcenable.func1()
            	runtime/mgc.go:200 +0x4c fp=0xc0000437c0 sp=0xc000043798 pc=0x32c3c
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0000437c0 sp=0xc0000437c0 pc=0x95924
            created by runtime.gcenable in goroutine 1
            	runtime/mgc.go:200 +0x78

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-26 03:21 linux-ppc64le-buildlet go@f90b4cd6 test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/index0.go (2.32s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            panic: runtime error: index out of range [19063680] with length 4028

            goroutine 1993 [running]:
            panic({0x929360?, 0xc001170f78?})
            	runtime/panic.go:1017 +0x448 fp=0xc000a11080 sp=0xc000a10fc0 pc=0x58ea8
            runtime.goPanicIndex(0x122e380, 0xfbc)
...
            cmd/compile/internal/ssagen.Compile(0xc002ebf600, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc000a11f30 sp=0xc000a11d60 pc=0x654c48
            cmd/compile/internal/gc.compileFunctions.func5.1(0xc0004f2a80?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc000a11f80 sp=0xc000a11f30 pc=0x85bf1c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc000a11fc0 sp=0xc000a11f80 pc=0x85c2e8
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc000a11fc0 sp=0xc000a11fc0 pc=0x95034
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 9
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-26 16:19 linux-ppc64le-buildlet go@76bb0caa test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/fixedbugs/bug513.go (2.87s)
        testdir_test.go:132: exit status 1
            # runtime
            <autogenerated>:1: internal compiler error: panic: runtime error: index out of range [0] with length 0

            goroutine 1 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0x6a14b4?, 0x0?}, {0x9627cb, 0x9}, {0xc001a1fad0, 0x1, 0x1})
...
            cmd/compile/internal/gc.compileFunctions.func2(0x775c523e05b8?)
            	cmd/compile/internal/gc/compile.go:138 +0x3c
            cmd/compile/internal/gc.compileFunctions.func5({0xc0019fe000, 0xb77, 0xd50?})
            	cmd/compile/internal/gc/compile.go:183 +0x88
            cmd/compile/internal/gc.compileFunctions()
            	cmd/compile/internal/gc/compile.go:194 +0x220
            cmd/compile/internal/gc.Main(0x999b00)
            	cmd/compile/internal/gc/main.go:344 +0x1764
            main.main()
            	cmd/compile/main.go:57 +0x134

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-26 23:31 linux-ppc64le-buildlet go@c2bb350d test.Test (log) 
--- FAIL: Test (0.02s)
    --- FAIL: Test/index0.go (1.69s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            runtime: marked free object in span 0x776649510468, elemsize=80 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
            0xc003022000 alloc marked  
            0xc003022050 alloc marked  
            0xc0030220a0 alloc marked  
            0xc0030220f0 free  unmarked
            0xc003022140 alloc marked  
...
            fatal error: found pointer to free object

            goroutine 3 [running]:
            runtime.throw({0x977fca?, 0xc003022960?})
            	runtime/panic.go:1077 +0x40 fp=0xc000043558 sp=0xc000043518 pc=0x59260
            runtime.(*mspan).reportZombies(0x776649510468)
            	runtime/mgcsweep.go:861 +0x30c fp=0xc0000435e8 sp=0xc000043558 pc=0x4321c
            runtime.(*sweepLocked).sweep(0x103b8a0?, 0x0)
            	runtime/mgcsweep.go:644 +0xe2c fp=0xc000043708 sp=0xc0000435e8 pc=0x42a2c
            runtime.sweepone(...)
            	runtime/mgcsweep.go:393
            runtime.bgsweep(0x0?)
            	runtime/mgcsweep.go:301 +0x1e4 fp=0xc000043798 sp=0xc000043708 pc=0x40eb4
            runtime.gcenable.func1()
            	runtime/mgc.go:200 +0x4c fp=0xc0000437c0 sp=0xc000043798 pc=0x3329c
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc0000437c0 sp=0xc0000437c0 pc=0x95034
            created by runtime.gcenable in goroutine 1
            	runtime/mgc.go:200 +0x7c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-30 16:37 linux-ppc64-sid-power10 go@5ad676a7 test.Test (log) 
--- FAIL: Test (0.01s)
    --- FAIL: Test/index0.go (1.55s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go3222761649/001/tmp__.go:1574:5: internal compiler error: 'main.func2184': unhandled stmt XXX

            goroutine 1278 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x50d7268?}, {0xc0050d7240, 0x17}, {0xc0056c5f20, 0x2, 0x2})
...
            cmd/compile/internal/ssagen.buildssa(0xc0033b2420, 0x0)
            	cmd/compile/internal/ssagen/ssa.go:548 +0x2374
            cmd/compile/internal/ssagen.Compile(0xc0033b2420, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 9
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-30 20:19 linux-ppc64-sid-buildlet go@ee402e98 test.Test (log) 
--- FAIL: Test (0.06s)
    --- FAIL: Test/fixedbugs/issue16037_run.go (7.96s)
        testdir_test.go:132: exit status 1
            2023/05/30 20:48:20 build failed: exit status 1
            # command-line-arguments
            panic: runtime error: index out of range [486539264] with length 3

            goroutine 3049 [running]:
            panic({0x9293a0?, 0xc0058e1ba8?})
            	runtime/panic.go:1017 +0x448 fp=0xc001165080 sp=0xc001164fc0 pc=0x58cb8
...
            cmd/compile/internal/ssagen.Compile(0xc002a64f20, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc001165f30 sp=0xc001165d60 pc=0x65e378
            cmd/compile/internal/gc.compileFunctions.func5.1(0xc0000721e0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc001165f80 sp=0xc001165f30 pc=0x8662fc
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc001165fc0 sp=0xc001165f80 pc=0x8666c8
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc001165fc0 sp=0xc001165fc0 pc=0x94dc4
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 33
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-30 19:11 aix-ppc64 go@301370c8 test.Test (log) 
--- FAIL: Test (0.05s)
    --- FAIL: Test/rotate3.go (6.20s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            runtime: marked free object in span 0xa00000046dbb3c8, elemsize=80 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
            0xa000100020a0000 free  marked   zombie
            0x0a000100020a0000:  0x0000000000000000  0x0400000000000000 
            0x0a000100020a0010:  0x0a000100000018c0  0x0000000000000000 
            0x0a000100020a0020:  0x0000000000000000  0x0000000000000000 
            0x0a000100020a0030:  0x0000000000000000  0x0000000100b36300 
...
            fatal error: found pointer to free object

            goroutine 3 [running]:
            runtime.throw({0x1009e05af?, 0xa000100020a0050?})
            	runtime/panic.go:1077 +0x40 fp=0xa00010000064d58 sp=0xa00010000064d18 pc=0x10004e1c0
            runtime.(*mspan).reportZombies(0xa00000046dbb3c8)
            	runtime/mgcsweep.go:861 +0x34c fp=0xa00010000064de8 sp=0xa00010000064d58 pc=0x10003634c
            runtime.(*sweepLocked).sweep(0x1101215c0?, 0x0)
            	runtime/mgcsweep.go:639 +0x420 fp=0xa00010000064f08 sp=0xa00010000064de8 pc=0x100034f70
            runtime.sweepone(...)
            	runtime/mgcsweep.go:393
            runtime.bgsweep(0x0?)
            	runtime/mgcsweep.go:301 +0x21c fp=0xa00010000064f98 sp=0xa00010000064f08 pc=0x100033cac
            runtime.gcenable.func1()
            	runtime/mgc.go:200 +0x4c fp=0xa00010000064fc0 sp=0xa00010000064f98 pc=0x100024bcc
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xa00010000064fc0 sp=0xa00010000064fc0 pc=0x10008c7e4
            created by runtime.gcenable in goroutine 1
            	runtime/mgc.go:200 +0x7c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-31 16:25 linux-ppc64-sid-buildlet go@d329fc5b test.Test (log) 
--- FAIL: Test (0.03s)
    --- FAIL: Test/fixedbugs/issue16037_run.go (5.29s)
        testdir_test.go:132: exit status 1
            2023/05/31 16:52:33 build failed: exit status 1
            # command-line-arguments
            panic: runtime error: invalid memory address or nil pointer dereference
            [signal SIGSEGV: segmentation violation code=0x1 addr=0x50 pc=0x66c924]

            goroutine 3482 [running]:
            panic({0x8e5280?, 0xf75c70?})
...
            cmd/compile/internal/ssagen.Compile(0xc00275de40, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48 fp=0xc00631df30 sp=0xc00631dd60 pc=0x65e378
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c fp=0xc00631df80 sp=0xc00631df30 pc=0x8662fc
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48 fp=0xc00631dfc0 sp=0xc00631df80 pc=0x8666c8
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc00631dfc0 sp=0xc00631dfc0 pc=0x94dc4
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 5
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-31 16:18 linux-ppc64le-buildlet go@8870c05b test.Test (log) 
--- FAIL: Test (0.04s)
    --- FAIL: Test/fixedbugs/bug513.go (3.27s)
        testdir_test.go:132: exit status 1
            # runtime
            panic: runtime error: index out of range [9360416] with length 7985 [recovered]
            	panic: runtime error: index out of range [9360416] with length 7985

            goroutine 1 [running]:
            panic({0x9293e0?, 0xc0045584e0?})
            	runtime/panic.go:1017 +0x448 fp=0xc002847f80 sp=0xc002847ec0 pc=0x58ea8
...
            cmd/compile/internal/gc.compileFunctions()
            	cmd/compile/internal/gc/compile.go:194 +0x220 fp=0xc00284b968 sp=0xc00284b8e8 pc=0x85bde0
            cmd/compile/internal/gc.Main(0x999bb0)
            	cmd/compile/internal/gc/main.go:344 +0x1764 fp=0xc00284bea8 sp=0xc00284b968 pc=0x85e134
            main.main()
            	cmd/compile/main.go:57 +0x134 fp=0xc00284bf18 sp=0xc00284bea8 pc=0x883a64
            runtime.main()
            	runtime/proc.go:267 +0x348 fp=0xc00284bfc0 sp=0xc00284bf18 pc=0x5beb8
            runtime.goexit()
            	runtime/asm_ppc64x.s:912 +0x4 fp=0xc00284bfc0 sp=0xc00284bfc0 pc=0x95034

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-31 19:56 linux-ppc64-sid-power10 go@9552a112 test.Test (log) 
--- FAIL: Test (0.01s)
    --- FAIL: Test/index0.go (1.83s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go1632655239/001/tmp__.go:2212:7: internal compiler error: 'main.func1788': local variable with class Pxxx unimplemented

            goroutine 1722 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xc0?, 0x66a36f8?}, {0xc00699b920, 0x30}, {0xc006a49cc0, 0x2, 0x2})
            	cmd/compile/internal/base/print.go:230 +0x250
            cmd/compile/internal/base.Fatalf(...)
            	cmd/compile/internal/base/print.go:199
            cmd/compile/internal/ssagen.(*ssafn).Fatalf(0x66c50c?, {0xc0?, 0x6ba2a48?}, {0x994060, 0x2a}, {0xc002507bb0, 0x1, 0x100000000000000?})
            	cmd/compile/internal/ssagen/ssa.go:7985 +0x1a0
            cmd/compile/internal/ssagen.(*state).Fatalf(0xc006a49ca0?, {0x994060?, 0xc0066a3a88?}, {0xc002507bb0?, 0x0?, 0x0?})
            	cmd/compile/internal/ssagen/ssa.go:932 +0xb8
            cmd/compile/internal/ssagen.buildssa(0xc0030fdce0, 0x1)
            	cmd/compile/internal/ssagen/ssa.go:479 +0x195c
            cmd/compile/internal/ssagen.Compile(0xc0030fdce0, 0x0?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x48
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 5
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "test" && test == "Test" && goarch ~ `^ppc64`
2023-05-31 19:08 aix-ppc64 go@481665ec test.Test (log) 
--- FAIL: Test (0.05s)
    --- FAIL: Test/index0.go (3.10s)
        testdir_test.go:132: exit status 1
            # command-line-arguments
            ../../tmp/Testindex0.go3539938630/001/tmp__.go:2535:7: internal compiler error: 'main.func2071': local variable with class Pxxx unimplemented

            goroutine 632 [running]:
            runtime/debug.Stack()
            	runtime/debug/stack.go:24 +0x6c
            cmd/compile/internal/base.FatalfAt({0xa000100?, 0x48d6f8?}, {0xa000100045c3620, 0x30}, {0xa00010004b0ac60, 0x2, 0x2})
            	cmd/compile/internal/base/print.go:230 +0x274
            cmd/compile/internal/base.Fatalf(...)
            	cmd/compile/internal/base/print.go:199
            cmd/compile/internal/ssagen.(*ssafn).Fatalf(0x1006b6544?, {0xa000100?, 0x3e91c28?}, {0x1009ec52b, 0x2a}, {0xa000100004fb330, 0x1, 0x100000000000000?})
            	cmd/compile/internal/ssagen/ssa.go:7985 +0x1b8
            cmd/compile/internal/ssagen.(*state).Fatalf(0xa00010004b0ac40?, {0x1009ec52b?, 0xa0001000048da88?}, {0xa000100004fb330?, 0xa00010003bec9a0?, 0xa00010003239600?})
            	cmd/compile/internal/ssagen/ssa.go:932 +0xd8
            cmd/compile/internal/ssagen.buildssa(0xa00010003458f20, 0x2)
            	cmd/compile/internal/ssagen/ssa.go:479 +0x1c94
            cmd/compile/internal/ssagen.Compile(0xa00010003458f20, 0xa0001000340cc60?)
            	cmd/compile/internal/ssagen/pgen.go:187 +0x48
            cmd/compile/internal/gc.compileFunctions.func5.1(0xa0001000340d8c0?)
            	cmd/compile/internal/gc/compile.go:184 +0x4c
            cmd/compile/internal/gc.compileFunctions.func3.1()
            	cmd/compile/internal/gc/compile.go:166 +0x54
            created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 8
            	cmd/compile/internal/gc/compile.go:165 +0x20c

— watchflakes

@bcmills
Copy link
Contributor

bcmills commented Jul 25, 2023

Given the timing this looks like #60368.

@bcmills
Copy link
Contributor

bcmills commented Jul 25, 2023

Duplicate of #60368

@bcmills bcmills marked this as a duplicate of #60368 Jul 25, 2023
@bcmills bcmills closed this as not planned Won't fix, can't repro, duplicate, stale Jul 25, 2023
@golang golang locked and limited conversation to collaborators Jul 24, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
arch-ppc64x Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Projects
Test Flakes
Archived in project
Milestone
Backlog
Development

No branches or pull requests
4 participants
@mknyszek @bcmills @gopherbot @pmur