Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build: OOM on windows-arm64 builder #69664

Closed
gopherbot opened this issue Sep 27, 2024 · 17 comments
Closed

x/build: OOM on windows-arm64 builder #69664

gopherbot opened this issue Sep 27, 2024 · 17 comments
Labels
Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done.
Milestone

Comments

@gopherbot
Copy link
Contributor

gopherbot commented Sep 27, 2024

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)

Issue created automatically to collect these failures.

Example (log):

=== RUN   TestHighlight
=== PAUSE TestHighlight
=== CONT  TestHighlight
    integration_test.go:479: gopls highlight a.go:4:7: exited with code 2, want success: true (gopls highlight a.go:4:7: exit=2 stdout=<<.\a.go:4:6-13
        .\a.go:5:6-13
        >> stderr=<<fatal error: runtime: cannot allocate memory
        
        runtime stack:
        runtime.throw({0x7ff65320093e?, 0x239bedb91a8?})
        	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:1067 +0x38 fp=0x54f0dff6e0 sp=0x54f0dff6b0 pc=0x7ff652654788
...
        golang.org/x/tools/gopls/internal/cache.(*analysisNode).run.func1()
        	C:/Users/swarming/.swarming/w/ir/x/w/targetrepo1381114845/gopls/internal/cache/analysis.go:820 +0x54 fp=0x400018bf60 sp=0x400018bf00 pc=0x7ff652db3744
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:78 +0x54 fp=0x400018bfd0 sp=0x400018bf60 pc=0x7ff652a74424
        runtime.goexit({})
        	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/[email protected]/src/runtime/asm_arm64.s:1223 +0x4 fp=0x400018bfd0 sp=0x400018bfd0 pc=0x7ff65265d7e4
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1537
        	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:75 +0x98
        >>)
--- FAIL: TestHighlight (9.18s)

watchflakes

@gopherbot gopherbot added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Sep 27, 2024
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- pkg == "golang.org/x/tools/gopls/internal/cmd" && test == "TestHighlight"
2024-09-22 20:55 x_tools-go1.22-windows-arm64 tools@d2c1642d release-branch.go1.22@b4086b7c x/tools/gopls/internal/cmd.TestHighlight (log)
=== RUN   TestHighlight
=== PAUSE TestHighlight
=== CONT  TestHighlight
    integration_test.go:479: gopls highlight a.go:4:7: exited with code 2, want success: true (gopls highlight a.go:4:7: exit=2 stdout=<<.\a.go:4:6-13
        .\a.go:5:6-13
        >> stderr=<<fatal error: runtime: cannot allocate memory
        
        runtime stack:
        runtime.throw({0x7ff65320093e?, 0x239bedb91a8?})
        	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:1067 +0x38 fp=0x54f0dff6e0 sp=0x54f0dff6b0 pc=0x7ff652654788
...
        golang.org/x/tools/gopls/internal/cache.(*analysisNode).run.func1()
        	C:/Users/swarming/.swarming/w/ir/x/w/targetrepo1381114845/gopls/internal/cache/analysis.go:820 +0x54 fp=0x400018bf60 sp=0x400018bf00 pc=0x7ff652db3744
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:78 +0x54 fp=0x400018bfd0 sp=0x400018bf60 pc=0x7ff652a74424
        runtime.goexit({})
        	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/[email protected]/src/runtime/asm_arm64.s:1223 +0x4 fp=0x400018bfd0 sp=0x400018bfd0 pc=0x7ff65265d7e4
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1537
        	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:75 +0x98
        >>)
--- FAIL: TestHighlight (9.18s)

watchflakes

@gopherbot gopherbot added Tools This label describes issues relating to any tools in the x/tools repository. gopls Issues related to the Go language server, gopls. labels Sep 27, 2024
@gopherbot gopherbot added this to the Unreleased milestone Sep 27, 2024
@adonovan adonovan changed the title x/tools/gopls/internal/cmd: TestHighlight failures x/build: OOM on windows-arm64 builder Sep 27, 2024
@gopherbot gopherbot added the Builders x/build issues (builders, bots, dashboards) label Sep 27, 2024
@dmitshur dmitshur moved this to Active in Test Flakes Sep 27, 2024
@gopherbot

This comment was marked as resolved.

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-09-22 20:55 x_tools-go1.23-windows-arm64 tools@d2c1642d release-branch.go1.23@c8c6f9ab x/tools/gopls/internal/cmd.TestCheck (log)
=== RUN   TestCheck
=== PAUSE TestCheck
=== CONT  TestCheck
    integration_test.go:125: gopls check ./a.go: exited with code 2, want success: true (gopls check ./a.go: exit=2 stdout=<<>> stderr=<<runtime: VirtualAlloc of 100007936 bytes failed with errno=1455
        fatal error: out of memory
        
        runtime stack:
        runtime.throw({0x7ff73d99dd24?, 0x400313e000?})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1067 +0x38 fp=0xae9cdffc00 sp=0xae9cdffbd0 pc=0x7ff73ce347d8
        runtime.sysUsedOS(0x4000500000, 0x5f60000)
...
        fatal error: out of memory
        
        runtime stack:
        runtime.throw({0x7ff73d99dd24?, 0x4002ea3000?})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1067 +0x38 fp=0x6dbb3ffba0 sp=0x6dbb3ffb70 pc=0x7ff73ce347d8
        runtime.sysUsedOS(0x400049c000, 0x5f60000)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mem_windows.go:83 +0x178 fp=0x6dbb3ffc00 sp=0x6dbb3ffba0 pc=0x7ff73cdd6a68
        runtime.sysUsed(...)
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mem.go:77
        runtime.(*mheap).allocSpan(0x7ff73e399e80, 0x2fb0, 0x0, 0x1)
...
        runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1735 +0x3c fp=0x4000495fd0 sp=0x4000495fa0 pc=0x7ff73cddc91c
        runtime.goexit({})
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1223 +0x4 fp=0x4000495fd0 sp=0x4000495fd0 pc=0x7ff73ce3d834
        created by unique.runtime_registerUniqueMapCleanup in goroutine 1
        	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1730 +0xa0
        >>)
    integration_test.go:133: gopls check ./a.go ./b.go: stdout does not match [a.go:.* fmt.Sprintf format %s has arg 123 of wrong type int]; got <<>>
    integration_test.go:134: gopls check ./a.go ./b.go: stdout does not match [b.go:.* fmt.Sprintf format %d has arg "123" of wrong type string]; got <<>>
--- FAIL: TestCheck (6.36s)
2024-09-22 20:55 x_tools-go1.23-windows-arm64 tools@d2c1642d release-branch.go1.23@c8c6f9ab x/tools/gopls/internal/test/integration/completion.TestPackageCompletion/package_completion_without_terminal_newline/default (log)
=== RUN   TestPackageCompletion/package_completion_without_terminal_newline/default
    completion_test.go:184: no views
#### Start Gopls Test Logs for "TestPackageCompletion/package_completion_without_terminal_newline/default"
[Trace - 23:53:54.600 PM] Sending request 'initialize - (1)'.
Params: {"processId":0,"clientInfo":{"name":"fake.Editor","version":"v1.0.0"},"rootUri":"","capabilities":{"workspace":{"workspaceEdit":{"resourceOperations":["rename"]},"didChangeConfiguration":{},"didChangeWatchedFiles":{"dynamicRegistration":true},"configuration":true},"textDocument":{"completion":{"completionItem":{"snippetSupport":true,"tagSupport":{"valueSet":[1]},"insertReplaceSupport":true}},"documentSymbol":{"hierarchicalDocumentSymbolSupport":true},"codeAction":{"codeActionLiteralSupport":{"codeActionKind":{"valueSet":null}}},"publishDiagnostics":{},"semanticTokens":{"requests":{"full":true},"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator","label"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary","interface","struct","signature","pointer","array","map","slice","chan","string","number","bool","invalid"],"formats":null}},"window":{"workDoneProgress":true}},"initializationOptions":{"completionBudget":"0s","diagnosticsDelay":"10ms","env":{"GO111MODULE":"","GOMODCACHE":"","GOPACKAGESDRIVER":"off","GOPATH":"C:\\Users\\swarming\\.swarming\\w\\ir\\x\\t\\gopls-test-518245704\\TestPackageCompletion\\package_completion_without_terminal_newline\\default\\gopath","GOPROXY":"file:///C:/Users/swarming/.swarming/w/ir/x/t/gopls-test-518245704/TestPackageCompletion/package_completion_without_terminal_newline/default/proxy","GOSUMDB":"off"},"verboseWorkDoneProgress":true},"trace":"messages","workspaceFolders":[{"uri":"file:///C:/Users/swarming/.swarming/w/ir/x/t/gopls-test-518245704/TestPackageCompletion/package_completion_without_terminal_newline/default/work","name":"work"}]}


[Trace - 23:53:54.600 PM] Received response 'initialize - (1)' in 0ms.
Result: {"capabilities":{"textDocumentSync":{"openClose":true,"change":2,"save":{}},"completionProvider":{"triggerCharacters":["."]},"hoverProvider":true,"signatureHelpProvider":{"triggerCharacters":["(",","]},"definitionProvider":true,"typeDefinitionProvider":true,"implementationProvider":true,"referencesProvider":true,"documentHighlightProvider":true,"documentSymbolProvider":true,"codeActionProvider":true,"codeLensProvider":{},"documentLinkProvider":{},"workspaceSymbolProvider":true,"documentFormattingProvider":true,"renameProvider":true,"foldingRangeProvider":true,"selectionRangeProvider":true,"executeCommandProvider":{"commands":["gopls.add_dependency","gopls.add_import","gopls.add_telemetry_counters","gopls.apply_fix","gopls.assembly","gopls.change_signature","gopls.check_upgrades","gopls.client_open_url","gopls.diagnose_files","gopls.doc","gopls.edit_go_directive","gopls.extract_to_new_file","gopls.fetch_vulncheck_result","gopls.free_symbols","gopls.gc_details","gopls.generate","gopls.go_get_package","gopls.list_imports","gopls.list_known_packages","gopls.maybe_prompt_for_telemetry","gopls.mem_stats","gopls.modules","gopls.packages","gopls.regenerate_cgo","gopls.remove_dependency","gopls.reset_go_mod_diagnostics","gopls.run_go_work_command","gopls.run_govulncheck","gopls.run_tests","gopls.scan_imports","gopls.start_debugging","gopls.start_profile","gopls.stop_profile","gopls.test","gopls.tidy","gopls.toggle_gc_details","gopls.update_go_sum","gopls.upgrade_dependency","gopls.vendor","gopls.views","gopls.workspace_stats"]},"callHierarchyProvider":true,"semanticTokensProvider":{"legend":{"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator","label"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary","interface","struct","signature","pointer","array","map","slice","chan","string","number","bool","invalid"]},"range":true,"full":true},"inlayHintProvider":{},"workspace":{"workspaceFolders":{"supported":true,"changeNotifications":"workspace/didChangeWorkspaceFolders"}}},"serverInfo":{"name":"gopls","version":"{\"GoVersion\":\"go1.23.1-devel_c8c6f9abfbbd2f949285a527036a3d0dbd991e74\",\"Path\":\"\",\"Main\":{\"Path\":\"\",\"Version\":\"\",\"Sum\":\"\",\"Replace\":null},\"Deps\":null,\"Settings\":null,\"Version\":\"(unknown)\"}"}}

...
        runtime.(*mheap).init(0x7ff7df3f4000)
        	runtime/mheap.go:767 +0x1b0 fp=0xd227dff860 sp=0xd227dff820 pc=0x7ff7de8b8420
        runtime.mallocinit()
        	runtime/malloc.go:451 +0xb4 fp=0xd227dff8a0 sp=0xd227dff860 pc=0x7ff7de89e234
        runtime.schedinit()
        	runtime/proc.go:818 +0xe0 fp=0xd227dff900 sp=0xd227dff8a0 pc=0x7ff7de8cc950
        runtime.rt0_go()
        	runtime/asm_arm64.s:86 +0xac fp=0xd227dff930 sp=0xd227dff900 pc=0x7ff7de905d3c
        ): exit status 2; removing files: <nil>
--- FAIL: TestPackageCompletion/package_completion_without_terminal_newline/default (0.21s)
2024-09-22 20:55 x_tools-go1.22-windows-arm64 tools@f8ce0052 release-branch.go1.22@b4086b7c x/tools/gopls/internal/cmd.TestCodeLens (log)
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens
    integration_test.go:236: gopls codelens -exec ./a/a_test.go:4 run test: stderr does not match [FAIL	example.com/a]; got <<2024/09/22 23:29:05 Error:2024/09/22 23:29:05 go/packages.Load #1: err: exit status 2: stderr: fatal error: runtime: cannot allocate memory
        
        runtime stack:
        runtime.throw({0x7ff78be01328?, 0x0?})
        	runtime/panic.go:1067 +0x38 fp=0x28a7bff970 sp=0x28a7bff940 pc=0x7ff78b7dfc18
        runtime.persistentalloc1(0x10d0, 0x4000057008?, 0x7ff78c319b78)
        	runtime/malloc.go:1609 +0x284 fp=0x28a7bff9c0 sp=0x28a7bff970 pc=0x7ff78b77f5b4
...
        cmd/go/internal/par.(*Queue).Add.func1()
        	cmd/go/internal/par/queue.go:56 fp=0x40001a3fd0 sp=0x40001a3fd0 pc=0x7ff78b9493f0
        runtime.goexit({})
        	runtime/asm_arm64.s:1223 +0x4 fp=0x40001a3fd0 sp=0x40001a3fd0 pc=0x7ff78b7e8284
        created by cmd/go/internal/par.(*Queue).Add in goroutine 7
        	cmd/go/internal/par/queue.go:56 +0x198
        
        gopls: no code lens at .\a\a_test.go:4 with title "run test"
        >>
--- FAIL: TestCodeLens (46.74s)
2024-09-22 20:55 x_tools-go1.22-windows-arm64 tools@f8ce0052 release-branch.go1.22@b4086b7c x/tools/gopls/internal/test/integration/completion.TestDefinition/default (log)
=== RUN   TestDefinition/default
    completion_test.go:839: completion item mismatch (-want +got):
          []string(
        - 	{"TestXxx(t *testing.T)", "TestMain(m *testing.M)"},
        + 	nil,
          )
        
    completion_test.go:839: completion item mismatch (-want +got):
          []string(
        - 	{"TestMain", "Test"},
...
[Trace - 23:31:53.356 PM] Received response 'textDocument/completion - (18)' in 0ms.
Result: {"isIncomplete":true,"items":[]}


[Trace - 23:31:53.356 PM] Received notification 'window/logMessage'.
Params: {"type":1,"message":"2024/09/22 23:31:53 no completions found: getting file file:///C:/Users/swarming/.swarming/w/ir/x/t/gopls-test-1004014129/TestDefinition/default/work/a_test.go for Completion: no package metadata for file file:///C:/Users/swarming/.swarming/w/ir/x/t/gopls-test-1004014129/TestDefinition/default/work/a_test.go (package completions: invalid position for package completion: cursor after expression)\n\tposition=1:7\n"}


#### End Gopls Test Logs for "TestDefinition/default"
--- FAIL: TestDefinition/default (8.48s)
2024-09-22 20:55 x_tools-go1.23-windows-arm64 tools@f8ce0052 release-branch.go1.23@c8c6f9ab x/tools/gopls/internal/test/integration/completion.TestCompleteAllFields/default [ABORT] (log)
=== RUN   TestCompleteAllFields/default
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff6c8c1df2d?, 0x4019145000?})
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1067 +0x38 fp=0xb8c79ff690 sp=0xb8c79ff660 pc=0x7ff6c80747d8
runtime.sysUsedOS(0x4019144000, 0x2000)
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mem_windows.go:83 +0x178 fp=0xb8c79ff6f0 sp=0xb8c79ff690 pc=0x7ff6c8016a68
runtime.sysUsed(...)
...
created by golang.org/x/tools/internal/jsonrpc2.(*conn).Go in goroutine 15417
	C:/Users/swarming/.swarming/w/ir/x/w/targetrepo907066028/internal/jsonrpc2/conn.go:188 +0x90

goroutine 19903 gp=0x400fda41c0 m=nil [runnable]:
golang.org/x/sync/errgroup.(*Group).Go.func1()
	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:75 fp=0x4000063fd0 sp=0x4000063fd0 pc=0x7ff6c83ee710
runtime.goexit({})
	C:/Users/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1223 +0x4 fp=0x4000063fd0 sp=0x4000063fd0 pc=0x7ff6c807d834
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 20344
	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:75 +0x98
2024-09-22 20:55 x_tools-go1.22-windows-arm64 tools@01bd772b release-branch.go1.22@b4086b7c x/tools/gopls/internal/test/integration/diagnostics.TestTimeFormatAnalyzer/default [ABORT] (log)
=== RUN   TestTimeFormatAnalyzer/default
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff6f04f5fbe?, 0x4013c50000?})
	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:1067 +0x38 fp=0x767edffd40 sp=0x767edffd10 pc=0x7ff6ef954788
runtime.sysUsedOS(0x4013c50000, 0x2000)
	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/[email protected]/src/runtime/mem_windows.go:83 +0x178 fp=0x767edffda0 sp=0x767edffd40 pc=0x7ff6ef8f6a38
runtime.sysUsed(...)
...
golang.org/x/tools/gopls/internal/mod.collectDiagnostics({0x7ff6f07eb400, 0x400a7371a0}, 0x4008710900, 0x7ff6f06a4960)
	C:/Users/swarming/.swarming/w/ir/x/w/targetrepo959152414/gopls/internal/mod/diagnostics.go:91 +0x2c4 fp=0x4006619f00 sp=0x4006619d80 pc=0x7ff6f01e42b4
golang.org/x/tools/gopls/internal/mod.TidyDiagnostics({0x7ff6f07eb400, 0x400a510660}, 0x4008710900)
	C:/Users/swarming/.swarming/w/ir/x/w/targetrepo959152414/gopls/internal/mod/diagnostics.go:42 +0x7c fp=0x4006619f70 sp=0x4006619f00 pc=0x7ff6f01e3d9c
golang.org/x/tools/gopls/internal/server.(*server).diagnose.func3()
	C:/Users/swarming/.swarming/w/ir/x/w/targetrepo959152414/gopls/internal/server/diagnostics.go:426 +0x5c fp=0x4006619fd0 sp=0x4006619f70 pc=0x7ff6f025b10c
runtime.goexit({})
	C:/Users/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/[email protected]/src/runtime/asm_arm64.s:1223 +0x4 fp=0x4006619fd0 sp=0x4006619fd0 pc=0x7ff6ef95d7e4
created by golang.org/x/tools/gopls/internal/server.(*server).diagnose in goroutine 2162
	C:/Users/swarming/.swarming/w/ir/x/w/targetrepo959152414/gopls/internal/server/diagnostics.go:424 +0x44c
2024-09-22 20:55 x_tools-go1.23-windows-arm64 tools@01bd772b release-branch.go1.23@c8c6f9ab [build] (log)
[I2024-09-22T21:11:12.304614Z 32172 0 sink.go:276] SinkServer: warm-up started
[I2024-09-22T21:11:12.304614Z 32172 0 sink.go:346] SinkServer: starting HTTP server...
[I2024-09-22T21:11:12.308366Z 32172 0 sink.go:281] SinkServer: warm-up ended
[I2024-09-22T21:11:12.312103Z 32172 0 cmd_stream.go:492] rdb-stream: starting the test command - ["C:\\Users\\swarming\\.swarming\\w\\ir\\cache\\tools\\bin\\result_adapter.exe" "go" "-v=false" "-dump-json" "C:\\Users\\swarming\\.swarming\\w\\ir\\x\\w\\go.testjson" "--" "C:\\Users\\swarming\\.swarming\\w\\ir\\x\\w\\goroot\\bin\\go" "test" "-json" "-short" "-timeout=20m0s" "./..."]
runtime: VirtualAlloc of 4194304 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff6abe21a39?, 0x4000cb9000?})
	runtime/panic.go:1023 +0x40 fp=0x429cfff820 sp=0x429cfff7f0 pc=0x7ff6ab67b8d0
...
[I2024-09-22T21:16:40.655349Z 32172 0 sink.go:371] SinkServer: shutdown started
[I2024-09-22T21:16:40.657748Z 32172 0 sink.go:349] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-09-22T21:16:40.657748Z 32172 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-09-22T21:16:40.657748Z 32172 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-09-22T21:16:40.657748Z 32172 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-09-22T21:16:40.657748Z 32172 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-09-22T21:16:40.657748Z 32172 0 sink.go:374] SinkServer: shutdown completed successfully
[I2024-09-22T21:16:40.662876Z 32172 0 cmd_stream.go:445] Caught InterruptEvent
[I2024-09-22T21:16:40.662876Z 32172 0 terminate_windows.go:40] Sending CTRL_BREAK_EVENT to the subprocess
[I2024-09-22T21:16:40.681519Z 32172 0 cmd_stream.go:420] rdb-stream: exiting with 2

watchflakes

@dmitshur
Copy link
Contributor

Issue #33986 is relevant.
Issue #66962 may also be relevant.

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-09-11 02:29 x_text-gotip-windows-arm64 text@38a95c2d go@7c72dc77 make.bat (log)
Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.22.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for windows/arm64.
# cmd/cover
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

...
fatal error: runtime: cannot allocate memory

runtime stack:
runtime.throw({0x7ff6f3d41b72?, 0xfffffffffffff800?})
	runtime/panic.go:1069 +0x38 fp=0x450edff820 sp=0x450edff7f0 pc=0x7ff6f3aaf068
runtime.persistentalloc1(0x1018, 0x7ff6f3f85700?, 0x7ff6f3fc89d8)
	runtime/malloc.go:1609 +0x284 fp=0x450edff870 sp=0x450edff820 pc=0x7ff6f3a4cff4
runtime.persistentalloc.func1()
	runtime/malloc.go:1562 +0x30 fp=0x450edff8a0 sp=0x450edff870 pc=0x7ff6f3a4cd50
runtime.systemstack(0x86)
...
	cmd/compile/internal/ssagen/pgen.go:304 +0x70 fp=0x400d5dff60 sp=0x400d5dfe80 pc=0x7ff7f0e82820
cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
	cmd/compile/internal/gc/compile.go:189 +0x40 fp=0x400d5dffa0 sp=0x400d5dff60 pc=0x7ff7f1047250
cmd/compile/internal/gc.compileFunctions.func3.1()
	cmd/compile/internal/gc/compile.go:171 +0x3c fp=0x400d5dffd0 sp=0x400d5dffa0 pc=0x7ff7f10475bc
runtime.goexit({})
	runtime/asm_arm64.s:1223 +0x4 fp=0x400d5dffd0 sp=0x400d5dffd0 pc=0x7ff7f0847794
created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 63
	cmd/compile/internal/gc/compile.go:170 +0x1e0
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\x\w\goroot\pkg\tool\windows_arm64\go_bootstrap install cmd: exit status 1
2024-09-20 19:10 gotip-windows-arm64 go@402dc987 cmd/internal/testdir.Test/fixedbugs/issue20749.go (log)
=== RUN   Test/fixedbugs/issue20749.go
=== PAUSE Test/fixedbugs/issue20749.go
=== CONT  Test/fixedbugs/issue20749.go
    testdir_test.go:1190: gc output:
        fatal error: runtime: cannot allocate memory
        
        goroutine 1 gp=0x400004a000 m=0 mp=0x7ff685cc2340 [running, locked to thread]:
        runtime.throw({0x7ff685547d8e?, 0x7ff684bfd2f0?})
        	runtime/panic.go:1069 +0x38 fp=0x400015bbc0 sp=0x400015bb90 pc=0x7ff684c104c8
        runtime.stkbucket(0x1, 0x1ea000, {0x4000038000, 0x5, 0x0?}, 0x1)
...
        fatal error: runtime: cannot allocate memory
        goroutine 1 gp=0x400004a000 m=0 mp=0x7ff685cc2340 [running, locked to thread]:
        runtime.throw({0x7ff685547d8e?, 0x7ff684bfd2f0?})
        	runtime/panic.go:1069 +0x38 fp=0x400015bbc0 sp=0x400015bb90 pc=0x7ff684c104c8
        runtime.stkbucket(0x1, 0x1ea000, {0x4000038000, 0x5, 0x0?}, 0x1)
        	runtime/mprof.go:284 +0x3f4 fp=0x400015bc20 sp=0x400015bbc0 pc=0x7ff684bc7484
        runtime.mProf_Malloc(0x7ff685cc2340, 0x4000180000, 0x1ea000)
        	runtime/mprof.go:450 +0xc0 fp=0x400015bcb0 sp=0x400015bc20 pc=0x7ff684bc78a0
        runtime.profilealloc(0x7ff685cc2340?, 0x4000180000?, 0x1ea000?)
        	runtime/malloc.go:1459 +0x84 fp=0x400015bce0 sp=0x400015bcb0 pc=0x7ff684ba05d4
...
        	runtime/mfinal.go:163 +0x80
        goroutine 6 gp=0x400004b180 m=nil [runnable]:
        runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
        	runtime/mgc.go:1729 fp=0x4000051fd0 sp=0x4000051fd0 pc=0x7ff684baffe0
        runtime.goexit({})
        	runtime/asm_arm64.s:1223 +0x4 fp=0x4000051fd0 sp=0x4000051fd0 pc=0x7ff684c17794
        created by unique.runtime_registerUniqueMapCleanup in goroutine 1
        	runtime/mgc.go:1729 +0xa0
        
--- FAIL: Test/fixedbugs/issue20749.go (0.50s)

watchflakes

@findleyr
Copy link
Member

Given that these OOMs started recently, I think we need to investigate recent changes in gopls and/or x/build. I initially thought this may be related to adding a 100MB ballast to gopls (https://go.dev/cl/608796), which on windows unlike linux or darwin actually consumes ram. However, the timing doesn't quite line up. (Nevertheless I will endeavor to remove that ballast, at least for testing).

@hyangah hyangah modified the milestones: Unreleased, gopls/v0.17.0 Oct 3, 2024
@dmitshur
Copy link
Contributor

dmitshur commented Oct 3, 2024

Are the OOMs in x/tools ongoing? If it was just that burst around September 20-22, I added some more detail in #66962 (comment) that's likely relevant.

@findleyr
Copy link
Member

findleyr commented Oct 3, 2024

The OOMs look like they were isolated to that time period. Therefore, closing. Thanks for the context.

@findleyr findleyr closed this as not planned Won't fix, can't repro, duplicate, stale Oct 3, 2024
@github-project-automation github-project-automation bot moved this from Active to Done in Test Flakes Oct 3, 2024
@gopherbot gopherbot reopened this Oct 29, 2024
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-10-28 22:46 x_tools-gotip-windows-arm64 tools@45a28e1c go@aef81a75 [build] (log)
[I2024-10-29T05:06:34.524585Z 3656 0 sink.go:276] SinkServer: warm-up started
[I2024-10-29T05:06:34.524585Z 3656 0 sink.go:346] SinkServer: starting HTTP server...
[I2024-10-29T05:06:34.532708Z 3656 0 sink.go:281] SinkServer: warm-up ended
[I2024-10-29T05:06:34.533749Z 3656 0 cmd_stream.go:492] rdb-stream: starting the test command - ["C:\\Users\\swarming\\.swarming\\w\\ir\\cache\\tools\\bin\\result_adapter.exe" "go" "-v=false" "-dump-json" "C:\\Users\\swarming\\.swarming\\w\\ir\\x\\w\\go.testjson" "--" "C:\\Users\\swarming\\.swarming\\w\\ir\\x\\w\\goroot\\bin\\go" "test" "-json" "-short" "-timeout=20m0s" "./..."]
runtime: VirtualAlloc of 8388608 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff6b07c637f?, 0x4000ebf000?})
	runtime/panic.go:1023 +0x40 fp=0xb38c7ff6b0 sp=0xb38c7ff680 pc=0x7ff6b001b8d0
...
	os/exec/exec.go:759 +0x818
[I2024-10-29T05:15:50.326748Z 3656 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-10-29T05:15:50.337913Z 3656 0 sink.go:371] SinkServer: shutdown started
[I2024-10-29T05:15:50.339155Z 3656 0 sink.go:349] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-10-29T05:15:50.339155Z 3656 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-10-29T05:15:50.339155Z 3656 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-10-29T05:15:50.339155Z 3656 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-10-29T05:15:50.339155Z 3656 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-10-29T05:15:50.339155Z 3656 0 sink.go:374] SinkServer: shutdown completed successfully
[I2024-10-29T05:15:50.342604Z 3656 0 cmd_stream.go:420] rdb-stream: exiting with 2
2024-10-28 23:45 gotip-windows-arm64 go@98b3be70 cmd/internal/testdir.Test/fixedbugs/issue16037_run.go (log)
=== RUN   Test/fixedbugs/issue16037_run.go
=== PAUSE Test/fixedbugs/issue16037_run.go
=== CONT  Test/fixedbugs/issue16037_run.go
    testdir_test.go:147: exit status 1
        2024/10/29 01:56:55 build failed: exit status 1
        # command-line-arguments
        fatal error: runtime: cannot allocate memory
        
        runtime stack:
        runtime.throw({0x7ff62c76610a?, 0xfffffffffffff800?})
...
        runtime.gcBgMarkWorker(0x4003c60540)
        	runtime/mgc.go:1363 +0xdc fp=0x4003c6bfb0 sp=0x4003c6bf00 pc=0x7ff62bdc000c
        runtime.gcBgMarkStartWorkers.gowrap1()
        	runtime/mgc.go:1279 +0x28 fp=0x4003c6bfd0 sp=0x4003c6bfb0 pc=0x7ff62bdbfef8
        runtime.goexit({})
        	runtime/asm_arm64.s:1260 +0x4 fp=0x4003c6bfd0 sp=0x4003c6bfd0 pc=0x7ff62be27744
        created by runtime.gcBgMarkStartWorkers in goroutine 1
        	runtime/mgc.go:1279 +0x140
        
--- FAIL: Test/fixedbugs/issue16037_run.go (9.39s)

watchflakes

@github-project-automation github-project-automation bot moved this from Done to Active in Test Flakes Oct 29, 2024
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-10-29 13:14 gotip-windows-arm64 go@fdfb3067 make.bat (log)
Building Go cmd/dist using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap. (go1.22.6 windows/arm64)
Building Go toolchain1 using C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap.
# bootstrap/cmd/internal/obj/ppc64
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory
runtime: VirtualAlloc of 294912 bytes failed with errno=1455
fatal error: out of memory
runtime: VirtualAlloc of 8192 bytes failed with errno=1455
fatal error: out of memory

...
fatal error: out of memory
runtime: VirtualAlloc of 49152 bytes failed with errno=1455
fatal error: out of memory
runtime: VirtualAlloc of 32768 bytes failed with errno=1455
fatal error: out of memory

runtime stack:
runtime.throw({0x7ff658009136?, 0x40043ff000?})
	runtime/panic.go:1023 +0x40 fp=0x82c6bff9c0 sp=0x82c6bff990 pc=0x7ff657706cf0
runtime.sysUsedOS(0x40043fe000, 0x2000)
...
	runtime/mem_windows.go:83 +0x178 fp=0x12ddfffd70 sp=0x12ddfffd10 pc=0x7ff6576df5c8
runtime.sysUsed(...)
	runtime/mem.go:77
runtime.(*mheap).allocSpan(0x7ff658756960, 0x1, 0x0, 0x2e)
	runtime/mheap.go:1347 +0x88c fp=0x12ddfffe80 sp=0x12ddfffd70 pc=0x7ff6576f4dcc
runtime.(*mheap).alloc.func1()
	runtime/mheap.go:964 +0x6c fp=0x12ddfffed0 sp=0x12ddfffe80 pc=0x7ff6576f3ffc
runtime.systemstack(0x0)
	runtime/asm_arm64.s:243 +0x6c fp=0x12ddfffee0 sp=0x12ddfffed0 pc=0x7ff65774131c
go tool dist: FAILED: C:\Users\swarming\.swarming\w\ir\cache\tools\go_bootstrap\bin\go install -tags=math_big_pure_go compiler_bootstrap purego bootstrap/cmd/...: exit status 1

watchflakes

@findleyr
Copy link
Member

findleyr commented Nov 5, 2024

This is a builder issue (failing in make.bat). Moving out of the gopls milestone.

@findleyr findleyr removed the gopls Issues related to the Go language server, gopls. label Nov 5, 2024
@findleyr findleyr modified the milestones: gopls/v0.17.0, Unreleased Nov 5, 2024
@findleyr findleyr removed the Tools This label describes issues relating to any tools in the x/tools repository. label Nov 5, 2024
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-11-21 15:52 gotip-windows-arm64 go@02df9bbd cmd/internal/testdir.Test/fixedbugs/issue48558.go (log)
=== RUN   Test/fixedbugs/issue48558.go
=== PAUSE Test/fixedbugs/issue48558.go
=== CONT  Test/fixedbugs/issue48558.go
    testdir_test.go:1193: gc output:
        fatal error: runtime: cannot allocate memory
        
        runtime stack:
        runtime.throw({0x7ff655a0dd4f?, 0x400000600c?})
        	runtime/panic.go:1099 +0x38 fp=0xf5b5dffa10 sp=0xf5b5dff9e0 pc=0x7ff655089ad8
        runtime.persistentalloc1(0x3fc0, 0x0?, 0x7ff65622c960)
...
        fatal error: runtime: cannot allocate memory
        runtime stack:
        runtime.throw({0x7ff655a0dd4f?, 0x400000600c?})
        	runtime/panic.go:1099 +0x38 fp=0xf5b5dffa10 sp=0xf5b5dff9e0 pc=0x7ff655089ad8
        runtime.persistentalloc1(0x3fc0, 0x0?, 0x7ff65622c960)
        	runtime/malloc.go:1957 +0x284 fp=0xf5b5dffa60 sp=0xf5b5dffa10 pc=0x7ff6550221c4
        runtime.persistentalloc.func1()
        	runtime/malloc.go:1910 +0x30 fp=0xf5b5dffa90 sp=0xf5b5dffa60 pc=0x7ff655021f20
        runtime.persistentalloc(0xf5b5dffb28?, 0x7ff65503c88c?, 0xf5b5dffb28?)
        	runtime/malloc.go:1909 +0x3c fp=0xf5b5dffae0 sp=0xf5b5dffa90 pc=0x7ff655021edc
...
        runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        	runtime/proc.go:435 +0xc8 fp=0x4000061d90 sp=0x4000061d70 pc=0x7ff655089bf8
        runtime.runfinq()
        	runtime/mfinal.go:196 +0x108 fp=0x4000061fd0 sp=0x4000061d90 pc=0x7ff655028aa8
        runtime.goexit({})
        	runtime/asm_arm64.s:1260 +0x4 fp=0x4000061fd0 sp=0x4000061fd0 pc=0x7ff655091114
        created by runtime.createfing in goroutine 1
        	runtime/mfinal.go:166 +0x80
        
--- FAIL: Test/fixedbugs/issue48558.go (0.23s)

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-11-21 18:23 x_tools-gotip-windows-arm64 tools@936a4010 go@b68f8ca8 x/tools/internal/gcimporter.TestStdlib/gotypesalias=1 (log)
=== RUN   TestStdlib/gotypesalias=1
    stdlib_test.go:52: failed to load/parse/type-check: err: exit status 2: stderr: runtime: VirtualAlloc of 8192 bytes failed with errno=1455
        fatal error: out of memory
        
        runtime stack:
        runtime.throw({0x7ff793391e8a?, 0x40004ba000?})
        	runtime/panic.go:1099 +0x38 fp=0x4d67ffb20 sp=0x4d67ffaf0 pc=0x7ff792d3b3a8
        runtime.sysUsedOS(0x40004ba000, 0x2000)
        	runtime/mem_windows.go:83 +0x178 fp=0x4d67ffb80 sp=0x4d67ffb20 pc=0x7ff792ce3bd8
        runtime.sysUsed(...)
...
        	cmd/go/internal/modload/load.go:2265 +0x30 fp=0x40001d7f00 sp=0x40001d7e40 pc=0x7ff7930e73b0
        cmd/go/internal/modload.matchPackages.func4.1.1()
        	cmd/go/internal/modload/search.go:136 +0x48 fp=0x40001d7f50 sp=0x40001d7f00 pc=0x7ff7930f68e8
        cmd/internal/par.(*Queue).Add.func1()
        	cmd/internal/par/queue.go:58 +0x60 fp=0x40001d7fd0 sp=0x40001d7f50 pc=0x7ff792ea5e90
        runtime.goexit({})
        	runtime/asm_arm64.s:1260 +0x4 fp=0x40001d7fd0 sp=0x40001d7fd0 pc=0x7ff792d42c64
        created by cmd/internal/par.(*Queue).Add in goroutine 1
        	cmd/internal/par/queue.go:56 +0x194
--- FAIL: TestStdlib/gotypesalias=1 (1.80s)

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-11-21 17:56 x_tools-gotip-windows-arm64 tools@1ffc3a16 go@b68f8ca8 x/tools/internal/gcimporter.TestStdlib/gotypesalias=1 (log)
=== RUN   TestStdlib/gotypesalias=1
    stdlib_test.go:52: failed to load/parse/type-check: err: exit status 1: stderr: runtime: VirtualAlloc of 40960 bytes failed with errno=1455
        fatal error: out of memory
        
        runtime stack:
        runtime.throw({0x7ff7b9ea84aa?, 0x400010e000?})
        	runtime/panic.go:1099 +0x38 fp=0x8b617ff7f0 sp=0x8b617ff7c0 pc=0x7ff7b9539a38
        runtime.sysUsedOS(0x400010e000, 0xa000)
        	runtime/mem_windows.go:83 +0x178 fp=0x8b617ff850 sp=0x8b617ff7f0 pc=0x7ff7b94d6668
        runtime.sysUsed(...)
...
        runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
        	runtime/mgc.go:1796
        runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
        	runtime/mgc.go:1799 +0x3c fp=0x4000053fd0 sp=0x4000053fa0 pc=0x7ff7b94dd05c
        runtime.goexit({})
        	runtime/asm_arm64.s:1260 +0x4 fp=0x4000053fd0 sp=0x4000053fd0 pc=0x7ff7b9541074
        created by unique.runtime_registerUniqueMapCleanup in goroutine 1
        	runtime/mgc.go:1794 +0x78
        go: error obtaining buildID for go tool compile: exit status 2
--- FAIL: TestStdlib/gotypesalias=1 (1.90s)

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-11-21 17:56 x_tools-gotip-windows-arm64 tools@442d6be7 go@b68f8ca8 x/tools/gopls/internal/test/integration/misc.TestSimultaneousEdits/default (log)
=== RUN   TestSimultaneousEdits/default
    shared_test.go:45: unmeetable expectations:
        Unmeetable: once "All of:\ncompleted work \"diagnosing opened files\" at least 1 time(s)\ncompleted work \"diagnosing changed files\" at least 1 time(s)" is met, must have:
        any diagnostics at the first position (7:0) matching `$` in "main.go"
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/11/24 17:21:57 Created View (#174)\n\tdirecto...
        	Error: "2024/11/24 17:21:57 go/packages.Load #285: err: e...
        	Error: "2024/11/24 17:21:57 initial workspace load failed...
...
        fatal error: out of memory
        
        runtime stack:
        runtime.throw({0x7ff74efb1e8a?, 0x4000154000?})
        	runtime/panic.go:1099 +0x38 fp=0x215a7ffaf0 sp=0x215a7ffac0 pc=0x7ff74e95b3a8
        runtime.sysUsedOS(0x4000152000, 0x4000)
        	runtime/mem_windows.go:83 +0x178 fp=0x215a7ffb50 sp=0x215a7ffaf0 pc=0x7ff74e903bd8
        runtime.sysUsed(...)
        	runtime/mem.go:77
        runtime.(*mheap).allocSpan(0x7ff74f4df720, 0x2, 0x0, 0x5c)
...
[Trace - 17:22:01.850 PM] Received notification 'textDocument/publishDiagnostics'.
Params: {"uri":"file:///C:/Users/swarming/.swarming/w/ir/x/t/gopls-test-2841442648/TestSimultaneousEdits/default/work/main.go","version":2,"diagnostics":[{"range":{"start":{"line":0,"character":8},"end":{"line":0,"character":12}},"severity":2,"source":"go list","message":"initialization failed: packages.Load error: err: exit status 2: stderr: runtime: VirtualAlloc of 8192 bytes failed with errno=1455\nfatal error: out of memory\n\nruntime stack:\nruntime.throw({0x7ff74efb1e8a?, 0x400046a000?})\n\truntime/panic.go:1099 +0x38 fp=0x125f7ffd70 sp=0x125f7ffd40 pc=0x7ff74e95b3a8\nruntime.sysUsedOS(0x400046a000, 0x2000)\n\truntime/mem_windows.go:83 +0x178 fp=0x125f7ffdd0 sp=0x125f7ffd70 pc=0x7ff74e903bd8\nruntime.sysUsed(...)\n\truntime/mem.go:77\nruntime.(*mheap).allocSpan(0x7ff74f4df720, 0x1, 0x0, 0x59)\n\truntime/mheap.go:1353 +0x444 fp=0x125f7ffe70 sp=0x125f7ffdd0 pc=0x7ff74e916d04\nruntime.(*mheap).alloc.func1()\n\truntime/mheap.go:970 +0x6c fp=0x125f7ffec0 sp=0x125f7ffe70 pc=0x7ff74e91651c\nruntime.systemstack(0x0)\n\truntime/asm_arm64.s:281 +0x6c fp=0x125f7ffed0 sp=0x125f7ffec0 pc=0x7ff74e96083c\n\ngoroutine 19 gp=0x4000204000 m=3 mp=0x4000059008 [running]:\nruntime.systemstack_switch()\n\truntime/asm_arm64.s:238 +0x8 fp=0x4000372f90 sp=0x4000372f80 pc=0x7ff74e9607b8\nruntime.(*mheap).alloc(0x4000373018?, 0x7ff74e902e9c?, 0x38?)\n\truntime/mheap.go:964 +0x54 fp=0x4000372fe0 sp=0x4000372f90 pc=0x7ff74e916484\nruntime.(*mcentral).grow(0x40003730b8?)\n\truntime/mcentral.go:254 +0x5c fp=0x4000373020 sp=0x4000372fe0 pc=0x7ff74e9033ec\nruntime.(*mcentral).cacheSpan(0x7ff74f4f54e0)\n\truntime/mcentral.go:170 +0x4ec fp=0x40003730a0 sp=0x4000373020 pc=0x7ff74e90325c\nruntime.(*mcache).refill(0x1abd60405a0, 0x59?)\n\truntime/mcache.go:183 +0x1ac fp=0x40003730f0 sp=0x40003730a0 pc=0x7ff74e90271c\nruntime.(*mcache).nextFree(0x1abd60405a0, 0x59)\n\truntime/malloc.go:964 +0x84 fp=0x4000373140 sp=0x40003730f0 pc=0x7ff74e8feb14\nruntime.mallocgcSmallNoscan(0x58?, 0x7ff74ef79f00?, 0x1)\n\truntime/malloc.go:1283 +0x18c fp=0x40003731a0 sp=0x4000373140 pc=0x7ff74e8ff11c\nruntime.mallocgc(0x1000, 0x7ff74eec99e0, 0x1)\n\truntime/malloc.go:1055 +0xa8 fp=0x40003731d0 sp=0x40003731a0 pc=0x7ff74e958e88\nruntime.makeslice(0x40003732a8?, 0x4000059008?, 0x4000373278?)\n\truntime/slice.go:116 +0x50 fp=0x4000373200 sp=0x40003731d0 pc=0x7ff74e95d580\nbufio.NewReaderSize(...)\n\tbufio/bufio.go:54\nbufio.NewReader(...)\n\tbufio/bufio.go:60\ncmd/go/internal/modindex.newImportReader({0x400008e1c0, 0x40}, {0x7ff74f0cf0e0, 0x40000a83e8?})\n\tcmd/go/internal/modindex/build_read.go:39 +0x90 fp=0x40003732a0 sp=0x4000373200 pc=0x7ff74ecc9930\ncmd/go/internal/modindex.readGoInfo({0x7ff74f0cf0e0?, 0x40000a83e8?}, 0x4000267440)\n\tcmd/go/internal/modindex/build_read.go:402 +0x48 fp=0x4000373440 sp=0x40003732a0 pc=0x7ff74eccaad8\ncmd/go/internal/modindex.getFileInfo({0x4000024300, 0x37}, {0x4000094b08, 0x8}, 0x40003b2cc0)\n\tcmd/go/internal/modindex/build.go:450 +0x4a4 fp=0x4000373510 sp=0x4000373440 pc=0x7ff74ecc6c64\ncmd/go/internal/modindex.importRaw({0x4000018720, 0x2f}, {0x4000024270, 0x7})\n\tcmd/go/internal/modindex/scan.go:220 +0x334 fp=0x4000373740 sp=0x4000373510 pc=0x7ff74ecd3854\ncmd/go/internal/modindex.indexPackage({0x4000018720, 0x2f}, {0x4000024240, 0x37})\n\tcmd/go/internal/modindex/scan.go:86 +0x60 fp=0x4000373780 sp=0x4000373740 pc=0x7ff74ecd3210\ncmd/go/internal/modindex.openIndexPackage.func1()\n\tcmd/go/internal/modindex/read.go:219 +0xc4 fp=0x4000373880 sp=0x4000373780 pc=0x7ff74eccca54\ncmd/internal/par.(*ErrCache[...]).Do.func1()\n\tcmd/internal/par/work.go:119 +0x24 fp=0x4000373890 sp=0x4000373880 pc=0x7ff74ecd58a4\ncmd/internal/par.(*Cache[...]).Do(0x7ff74f0da540, {{0x4000018720, 0x2f}, {0x4000024240, 0x37}}, 0x40002d3950)\n\tcmd/internal/par/work.go:160 +0x134 fp=0x4000373910 sp=0x4000373890 pc=0x7ff74ecd5ad4\ncmd/internal/par.(*ErrCache[...]).Do(0x2f?, {{0x4000018720, 0x2f}, {0x4000024240, 0x37}}, 0x40002d39f8?)\n\tcmd/internal/par/work.go:118 +0x4c fp=0x4000373970 sp=0x4000373910 pc=0x7ff74ecd584c\ncmd/go/internal/modindex.openIndexPackage({0x4000018720?, 0x400003c9a0?}, {0x4000024240?, 0x400003c9a0?})\n\tcmd/go/internal/modindex/read.go:209 +0x84 fp=0x4000373a00 sp=0x4000373970 pc=0x7ff74eccc964\ncmd/go/internal/modindex.GetPackage({0x4000018720, 0x2f}, {0x4000024240, 0x37})\n\tcmd/go/internal/modindex/read.go:146 +0x158 fp=0x4000373a50 sp=0x4000373a00 pc=0x7ff74eccc4b8\ncmd/go/internal/modindex.IsStandardPackage({0x4000020440, 0x2b}, {0x7ff74efaaf41, 0x2}, {0x400000b9a7, 0x7})\n\tcmd/go/internal/modindex/read.go:677 +0x1a4 fp=0x4000373b30 sp=0x4000373a50 pc=0x7ff74ecd0744\ncmd/go/internal/modload.importFromModules({0x7ff74f0d57a0, 0x7ff74f51f7e0}, {0x400000b9a7, 0x7}, 0x40001ba0f0, 0x40001f6180, 0x0)\n\tcmd/go/internal/modload/import.go:301 +0x40c fp=0x4000373e60 sp=0x4000373b30 pc=0x7ff74ecec42c\ncmd/go/internal/modload.(*loader).load(0x4000202000, {0x7ff74f0d57a0, 0x7ff74f51f7e0}, 0x40000a6750)\n\tcmd/go/internal/modload/load.go:1854 +0x90 fp=0x4000373f20 sp=0x4000373e60 pc=0x7ff74ed05010\ncmd/go/internal/modload.(*loader).pkg.func1.1()\n\tcmd/go/internal/modload/load.go:1667 +0x2c fp=0x4000373f50 sp=0x4000373f20 pc=0x7ff74ed040ac\ncmd/internal/par.(*Queue).Add.func1()\n\tcmd/internal/par/queue.go:58 +0x60 fp=0x4000373fd0 sp=0x4000373f50 pc=0x7ff74eac5e90\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x4000373fd0 sp=0x4000373fd0 pc=0x7ff74e962c64\ncreated by cmd/internal/par.(*Queue).Add in goroutine 34\n\tcmd/internal/par/queue.go:56 +0x194\n\ngoroutine 1 gp=0x400004c000 m=nil [chan receive]:\nruntime.gopark(0x40001584a8?, 0x7ff74ed0150c?, 0x48?, 0x84?, 0x0?)\n\truntime/proc.go:435 +0xc8 fp=0x40000a0400 sp=0x40000a03e0 pc=0x7ff74e95b4c8\nruntime.chanrecv(0x40002941c0, 0x0, 0x1)\n\truntime/chan.go:664 +0x43c fp=0x40000a0480 sp=0x40000a0400 pc=0x7ff74e8f834c\nruntime.chanrecv1(0x40001a12d0?, 0x4000158760?)\n\truntime/chan.go:506 +0x14 fp=0x40000a04b0 sp=0x40000a0480 pc=0x7ff74e8f7ed4\ncmd/go/internal/modload.loadFromRoots({0x7ff74f0d57a0, 0x7ff74f51f7e0}, {{{0x0, 0x0}, 0x40001f0240, 0x0, 0x0, {0x0, 0x0}, 0x0, ...}, ...})\n\tcmd/go/internal/modload/load.go:1163 +0x324 fp=0x40000a08a0 sp=0x40000a04b0 pc=0x7ff74ed01514\ncmd/go/internal/modload.LoadPackages({0x7ff74f0d57a0, 0x7ff74f51f7e0}, {{0x0, 0x0}, 0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, ...}, ...)\n\tcmd/go/internal/modload/load.go:366 +0x3dc fp=0x40000a0bc0 sp=0x40000a08a0 pc=0x7ff74ecfd6ac\ncmd/go/internal/load.PackagesAndErrors({0x7ff74f0d57a0?, 0x7ff74f51f7e0?}, {0x0, 0x1, 0x0, 0x1, 0x1, 0x0}, {0x40001020b0, 0x2, ...})\n\tcmd/go/internal/load/pkg.go:2892 +0x27c fp=0x40000a0e90 sp=0x40000a0bc0 pc=0x7ff74ed4e62c\ncmd/go/internal/list.runList({0x7ff74f0d57a0, 0x7ff74f51f7e0}, 0x4000184858?, {0x40001020b0, 0x2, 0x5})\n\tcmd/go/internal/list/list.go:618 +0xc20 fp=0x40000a19b0 sp=0x40000a0e90 pc=0x7ff74edf6060\nmain.invoke(0x7ff74f4c3fe0, {0x4000102010, 0xc, 0xf})\n\tcmd/go/main.go:341 +0x66c fp=0x40000a1cc0 sp=0x40000a19b0 pc=0x7ff74ee3c45c\nmain.main()\n\tcmd/go/main.go:220 +0xd90 fp=0x40000a1f40 sp=0x40000a1cc0 pc=0x7ff74ee3b740\nruntime.main()\n\truntime/proc.go:283 +0x26c fp=0x40000a1fd0 sp=0x40000a1f40 pc=0x7ff74e9290ac\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x40000a1fd0 sp=0x40000a1fd0 pc=0x7ff74e962c64\n\ngoroutine 2 gp=0x400004c700 m=nil [force gc (idle)]:\nruntime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)\n\truntime/proc.go:435 +0xc8 fp=0x400004ff90 sp=0x400004ff70 pc=0x7ff74e95b4c8\nruntime.goparkunlock(...)\n\truntime/proc.go:441\nruntime.forcegchelper()\n\truntime/proc.go:348 +0xb8 fp=0x400004ffd0 sp=0x400004ff90 pc=0x7ff74e9293e8\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x400004ffd0 sp=0x400004ffd0 pc=0x7ff74e962c64\ncreated by runtime.init.7 in goroutine 1\n\truntime/proc.go:336 +0x24\n\ngoroutine 3 gp=0x400004ca80 m=nil [GC sweep wait]:\nruntime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)\n\truntime/proc.go:435 +0xc8 fp=0x4000051f60 sp=0x4000051f40 pc=0x7ff74e95b4c8\nruntime.goparkunlock(...)\n\truntime/proc.go:441\nruntime.bgsweep(0x4000028080)\n\truntime/mgcsweep.go:316 +0x108 fp=0x4000051fb0 sp=0x4000051f60 pc=0x7ff74e912bf8\nruntime.gcenable.gowrap1()\n\truntime/mgc.go:204 +0x28 fp=0x4000051fd0 sp=0x4000051fb0 pc=0x7ff74e906a78\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x4000051fd0 sp=0x4000051fd0 pc=0x7ff74e962c64\ncreated by runtime.gcenable in goroutine 1\n\truntime/mgc.go:204 +0x6c\n\ngoroutine 4 gp=0x400004cc40 m=nil [GC scavenge wait]:\nruntime.gopark(0x28ba90?, 0x3b9aca00?, 0x0?, 0x0?, 0x0?)\n\truntime/proc.go:435 +0xc8 fp=0x4000061f60 sp=0x4000061f40 pc=0x7ff74e95b4c8\nruntime.goparkunlock(...)\n\truntime/proc.go:441\nruntime.(*scavengerState).park(0x7ff74f4d1da0)\n\truntime/mgcscavenge.go:425 +0x5c fp=0x4000061f90 sp=0x4000061f60 pc=0x7ff74e9106cc\nruntime.bgscavenge(0x4000028080)\n\truntime/mgcscavenge.go:658 +0xac fp=0x4000061fb0 sp=0x4000061f90 pc=0x7ff74e910c4c\nruntime.gcenable.gowrap2()\n\truntime/mgc.go:205 +0x28 fp=0x4000061fd0 sp=0x4000061fb0 pc=0x7ff74e906a18\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x4000061fd0 sp=0x4000061fd0 pc=0x7ff74e962c64\ncreated by runtime.gcenable in goroutine 1\n\truntime/mgc.go:205 +0xac\n\ngoroutine 5 gp=0x400004cfc0 m=nil [finalizer wait]:\nruntime.gopark(0x0?, 0x7ff74f00bf70?, 0x0?, 0x40?, 0x2000000020?)\n\truntime/proc.go:435 +0xc8 fp=0x4000063d90 sp=0x4000063d70 pc=0x7ff74e95b4c8\nruntime.runfinq()\n\truntime/mfinal.go:196 +0x108 fp=0x4000063fd0 sp=0x4000063d90 pc=0x7ff74e905ab8\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x4000063fd0 sp=0x4000063fd0 pc=0x7ff74e962c64\ncreated by runtime.createfing in goroutine 1\n\truntime/mfinal.go:166 +0x80\n\ngoroutine 6 gp=0x400004d180 m=nil [chan receive]:\nruntime.gopark(0x400006e5a0?, 0x40001b0ae0?, 0x48?, 0x3f?, 0x7ff74eb33738?)\n\truntime/proc.go:435 +0xc8 fp=0x4000053ef0 sp=0x4000053ed0 pc=0x7ff74e95b4c8\nruntime.chanrecv(0x4000023f80, 0x0, 0x1)\n\truntime/chan.go:664 +0x43c fp=0x4000053f70 sp=0x4000053ef0 pc=0x7ff74e8f834c\nruntime.chanrecv1(0x7ff74f4d3b80?, 0x7ff74e929210?)\n\truntime/chan.go:506 +0x14 fp=0x4000053fa0 sp=0x4000053f70 pc=0x7ff74e8f7ed4\nruntime.unique_runtime_registerUniqueMapCleanup.func2(...)\n\truntime/mgc.go:1796\nruntime.unique_runtime_registerUniqueMapCleanup.gowrap1()\n\truntime/mgc.go:1799 +0x3c fp=0x4000053fd0 sp=0x4000053fa0 pc=0x7ff74e909cbc\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x4000053fd0 sp=0x4000053fd0 pc=0x7ff74e962c64\ncreated by unique.runtime_registerUniqueMapCleanup in goroutine 1\n\truntime/mgc.go:1794 +0x78\n\ngoroutine 22 gp=0x4000204e00 m=nil [runnable]:\nruntime.cgocall(0x7ff74e963960, 0x4000080348)\n\truntime/cgocall.go:167 +0x38 fp=0x40000a5220 sp=0x40000a51b0 pc=0x7ff74e9584b8\nruntime.syscall_syscalln(0x400048bd00?, 0x4c?, {0x40000a5270?, 0x0?, 0x40000a52e8?})\n\truntime/syscall_windows.go:521 +0x4c fp=0x40000a5240 sp=0x40000a5220 pc=0x7ff74e945e5c\nsyscall.Syscall(0x40000a5328?, 0x7ff74e9f9118?, 0x400048bd00?, 0x380000000?, 0x4a?)\n\truntime/syscall_windows.go:457 +0x28 fp=0x40000a5290 sp=0x40000a5240 pc=0x7ff74e95eb68\nsyscall.GetFileType(0x2b0)\n\tsyscall/zsyscall_windows.go:774 +0x54 fp=0x40000a52e0 sp=0x40000a5290 pc=0x7ff74e98cef4\nos.newFile(0x2b0, {0x400048bd00, 0x4c}, {0x7ff74efab661, 0x4})\n\tos/file_windows.go:55 +0x88 fp=0x40000a5330 sp=0x40000a52e0 pc=0x7ff74e9f8f58\nos.openFileNolog({0x400048bd00, 0x4c}, 0x400048bd00?, 0x0?)\n\tos/file_windows.go:110 +0x12c fp=0x40000a5380 sp=0x40000a5330 pc=0x7ff74e9f91bc\nos.OpenFile({0x400048bd00, 0x4c}, 0x0, 0x0)\n\tos/file.go:392 +0x40 fp=0x40000a53b0 sp=0x40000a5380 pc=0x7ff74e9f78d0\nos.Open(...)\n\tos/file.go:370\ncmd/go/internal/fsys.Open({0x400048bd00, 0x4c})\n\tcmd/go/internal/fsys/fsys.go:547 +0xb8 fp=0x40000a5440 sp=0x40000a53b0 pc=0x7ff74eabf098\ncmd/go/internal/modindex.getFileInfo({0x4000256180, 0x37}, {0x4000244810, 0x14}, 0x40003e8cc0)\n\tcmd/go/internal/modindex/build.go:441 +0x448 fp=0x40000a5510 sp=0x40000a5440 pc=0x7ff74ecc6c08\ncmd/go/internal/modindex.importRaw({0x400028b710, 0x2f}, {0x4000256150, 0x7})\n\tcmd/go/internal/modindex/scan.go:220 +0x334 fp=0x40000a5740 sp=0x40000a5510 pc=0x7ff74ecd3854\ncmd/go/internal/modindex.indexPackage({0x400028b710, 0x2f}, {0x4000256120, 0x37})\n\tcmd/go/internal/modindex/scan.go:86 +0x60 fp=0x40000a5780 sp=0x40000a5740 pc=0x7ff74ecd3210\ncmd/go/internal/modindex.openIndexPackage.func1()\n\tcmd/go/internal/modindex/read.go:219 +0xc4 fp=0x40000a5880 sp=0x40000a5780 pc=0x7ff74eccca54\ncmd/internal/par.(*ErrCache[...]).Do.func1()\n\tcmd/internal/par/work.go:119 +0x24 fp=0x40000a5890 sp=0x40000a5880 pc=0x7ff74ecd58a4\ncmd/internal/par.(*Cache[...]).Do(0x7ff74f0da540, {{0x400028b710, 0x2f}, {0x4000256120, 0x37}}, 0x4000035950)\n\tcmd/internal/par/work.go:160 +0x134 fp=0x40000a5910 sp=0x40000a5890 pc=0x7ff74ecd5ad4\ncmd/internal/par.(*ErrCache[...]).Do(0x2f?, {{0x400028b710, 0x2f}, {0x4000256120, 0x37}}, 0x40000359f8?)\n\tcmd/internal/par/work.go:118 +0x4c fp=0x40000a5970 sp=0x40000a5910 pc=0x7ff74ecd584c\ncmd/go/internal/modindex.openIndexPackage({0x400028b710?, 0x400003c9a0?}, {0x4000256120?, 0x400003c9a0?})\n\tcmd/go/internal/modindex/read.go:209 +0x84 fp=0x40000a5a00 sp=0x40000a5970 pc=0x7ff74eccc964\ncmd/go/internal/modindex.GetPackage({0x400028b710, 0x2f}, {0x4000256120, 0x37})\n\tcmd/go/internal/modindex/read.go:146 +0x158 fp=0x40000a5a50 sp=0x40000a5a00 pc=0x7ff74eccc4b8\ncmd/go/internal/modindex.IsStandardPackage({0x4000020440, 0x2b}, {0x7ff74efaaf41, 0x2}, {0x400033d31d, 0x7})\n\tcmd/go/internal/modindex/read.go:677 +0x1a4 fp=0x40000a5b30 sp=0x40000a5a50 pc=0x7ff74ecd0744\ncmd/go/internal/modload.importFromModules({0x7ff74f0d57a0, 0x7ff74f51f7e0}, {0x400033d31d, 0x7}, 0x40001ba0f0, 0x40001f6180, 0x0)\n\tcmd/go/internal/modload/import.go:301 +0x40c fp=0x40000a5e60 sp=0x40000a5b30 pc=0x7ff74ecec42c\ncmd/go/internal/modload.(*loader).load(0x4000202000, {0x7ff74f0d57a0, 0x7ff74f51f7e0}, 0x4000196340)\n\tcmd/go/internal/modload/load.go:1854 +0x90 fp=0x40000a5f20 sp=0x40000a5e60 pc=0x7ff74ed05010\ncmd/go/internal/modload.(*loader).pkg.func1.1()\n\tcmd/go/internal/modload/load.go:1667 +0x2c fp=0x40000a5f50 sp=0x40000a5f20 pc=0x7ff74ed040ac\ncmd/internal/par.(*Queue).Add.func1()\n\tcmd/internal/par/queue.go:58 +0x60 fp=0x40000a5fd0 sp=0x40000a5f50 pc=0x7ff74eac5e90\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x40000a5fd0 sp=0x40000a5fd0 pc=0x7ff74e962c64\ncreated by cmd/internal/par.(*Queue).Add in goroutine 19\n\tcmd/internal/par/queue.go:56 +0x194\n\ngoroutine 50 gp=0x4000086540 m=nil [GC worker (idle)]:\nruntime.gopark(0x5d18208d2f6c0?, 0x7ff74eac5e90?, 0x0?, 0x20?, 0x7ff74f0d57a0?)\n\truntime/proc.go:435 +0xc8 fp=0x40002cbf10 sp=0x40002cbef0 pc=0x7ff74e95b4c8\nruntime.gcBgMarkWorker(0x4000410150)\n\truntime/mgc.go:1423 +0xdc fp=0x40002cbfb0 sp=0x40002cbf10 pc=0x7ff74e908f0c\nruntime.gcBgMarkStartWorkers.gowrap1()\n\truntime/mgc.go:1339 +0x28 fp=0x40002cbfd0 sp=0x40002cbfb0 pc=0x7ff74e908df8\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x40002cbfd0 sp=0x40002cbfd0 pc=0x7ff74e962c64\ncreated by runtime.gcBgMarkStartWorkers in goroutine 21\n\truntime/mgc.go:1339 +0x140\n\ngoroutine 51 gp=0x4000086700 m=nil [GC worker (idle)]:\nruntime.gopark(0x5d18208d2f6c0?, 0x0?, 0x0?, 0x0?, 0x0?)\n\truntime/proc.go:435 +0xc8 fp=0x40002c7f10 sp=0x40002c7ef0 pc=0x7ff74e95b4c8\nruntime.gcBgMarkWorker(0x4000410150)\n\truntime/mgc.go:1423 +0xdc fp=0x40002c7fb0 sp=0x40002c7f10 pc=0x7ff74e908f0c\nruntime.gcBgMarkStartWorkers.gowrap1()\n\truntime/mgc.go:1339 +0x28 fp=0x40002c7fd0 sp=0x40002c7fb0 pc=0x7ff74e908df8\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x40002c7fd0 sp=0x40002c7fd0 pc=0x7ff74e962c64\ncreated by runtime.gcBgMarkStartWorkers in goroutine 21\n\truntime/mgc.go:1339 +0x140\n\ngoroutine 52 gp=0x40000868c0 m=nil [GC worker (idle)]:\nruntime.gopark(0x5d18208ca856c?, 0x0?, 0x0?, 0x0?, 0x0?)\n\truntime/proc.go:435 +0xc8 fp=0x40002c9f10 sp=0x40002c9ef0 pc=0x7ff74e95b4c8\nruntime.gcBgMarkWorker(0x4000410150)\n\truntime/mgc.go:1423 +0xdc fp=0x40002c9fb0 sp=0x40002c9f10 pc=0x7ff74e908f0c\nruntime.gcBgMarkStartWorkers.gowrap1()\n\truntime/mgc.go:1339 +0x28 fp=0x40002c9fd0 sp=0x40002c9fb0 pc=0x7ff74e908df8\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x40002c9fd0 sp=0x40002c9fd0 pc=0x7ff74e962c64\ncreated by runtime.gcBgMarkStartWorkers in goroutine 21\n\truntime/mgc.go:1339 +0x140\n\ngoroutine 53 gp=0x4000086a80 m=nil [GC worker (idle)]:\nruntime.gopark(0x5d18208340d1c?, 0x0?, 0x0?, 0x0?, 0x0?)\n\truntime/proc.go:435 +0xc8 fp=0x4000431f10 sp=0x4000431ef0 pc=0x7ff74e95b4c8\nruntime.gcBgMarkWorker(0x4000410150)\n\truntime/mgc.go:1423 +0xdc fp=0x4000431fb0 sp=0x4000431f10 pc=0x7ff74e908f0c\nruntime.gcBgMarkStartWorkers.gowrap1()\n\truntime/mgc.go:1339 +0x28 fp=0x4000431fd0 sp=0x4000431fb0 pc=0x7ff74e908df8\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x4000431fd0 sp=0x4000431fd0 pc=0x7ff74e962c64\ncreated by runtime.gcBgMarkStartWorkers in goroutine 21\n\truntime/mgc.go:1339 +0x140"},{"range":{"start":{"line":5,"character":5},"end":{"line":5,"character":11}},"severity":1,"code":"UndeclaredImportedName","codeDescription":{"href":"https://pkg.go.dev/golang.org/x/tools/internal/typesinternal#UndeclaredImportedName"},"source":"compiler","message":"undefined: fmt.Printl"}]}


[Trace - 17:22:01.851 PM] Received notification '$/progress'.
Params: {"token":"704075565650664925","value":{"kind":"end","message":"Done."}}


#### End Gopls Test Logs for "TestSimultaneousEdits/default"
--- FAIL: TestSimultaneousEdits/default (6.01s)
2024-11-21 17:56 x_tools-gotip-windows-arm64 tools@442d6be7 go@b68f8ca8 x/tools/gopls/internal/test/integration/workspace.TestClearAnalysisDiagnostics/default (log)
=== RUN   TestClearAnalysisDiagnostics/default
    workspace_test.go:158: waiting on:
        Unmeetable: once "All of:\ncompleted work \"diagnosing opened files\" at least 1 time(s)" is met, must have:
        any diagnostics at the first position (5:1) matching `fmt.Print` in "pkg/main2.go"
        
        err:condition has final verdict Unmeetable
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/11/24 17:20:33 Created View (#50)\n\tdirector...
...
        fatal error: runtime: cannot allocate memory
        
        runtime stack:
        runtime.throw({0x7ff716dee44c?, 0x0?})
        	runtime/panic.go:1099 +0x38 fp=0x267fbff560 sp=0x267fbff530 pc=0x7ff716469a38
        runtime.persistentalloc1(0x3fc0, 0x7ffb4e747000?, 0x7ff71760f020)
        	runtime/malloc.go:1957 +0x284 fp=0x267fbff5b0 sp=0x267fbff560 pc=0x7ff7164021a4
        runtime.persistentalloc.func1()
        	runtime/malloc.go:1910 +0x30 fp=0x267fbff5e0 sp=0x267fbff5b0 pc=0x7ff716401f00
        runtime.persistentalloc(0x267fbff678?, 0x7ff71641c83c?, 0x267fbff678?)
...
[Trace - 17:20:38.282 PM] Received notification 'textDocument/publishDiagnostics'.
Params: {"uri":"file:///C:/Users/swarming/.swarming/w/ir/x/t/gopls-test-1038659297/TestClearAnalysisDiagnostics/default/work/pkg/main.go","version":1,"diagnostics":[{"range":{"start":{"line":0,"character":8},"end":{"line":0,"character":12}},"severity":2,"source":"go list","message":"initialization failed: packages.Load error: err: exit status 1: stderr: go: downloading example.com v1.2.3\ngo: downloading random.org v1.2.3\nfatal error: runtime: cannot allocate memory\n\nruntime stack:\nruntime.throw({0x7ff716dee44c?, 0x0?})\n\truntime/panic.go:1099 +0x38 fp=0x267fbff560 sp=0x267fbff530 pc=0x7ff716469a38\nruntime.persistentalloc1(0x3fc0, 0x7ffb4e747000?, 0x7ff71760f020)\n\truntime/malloc.go:1957 +0x284 fp=0x267fbff5b0 sp=0x267fbff560 pc=0x7ff7164021a4\nruntime.persistentalloc.func1()\n\truntime/malloc.go:1910 +0x30 fp=0x267fbff5e0 sp=0x267fbff5b0 pc=0x7ff716401f00\nruntime.persistentalloc(0x267fbff678?, 0x7ff71641c83c?, 0x267fbff678?)\n\truntime/malloc.go:1909 +0x3c fp=0x267fbff630 sp=0x267fbff5e0 pc=0x7ff716401ebc\nruntime.(*fixalloc).alloc(...)\n\truntime/mfixalloc.go:90\nruntime.(*mheap).allocMSpanLocked(0x7ff7175c9100)\n\truntime/mheap.go:1125 +0x148 fp=0x267fbff680 sp=0x267fbff630 pc=0x7ff71641c4c8\nruntime.(*mheap).allocSpan(0x7ff7175c9100, 0x1, 0x0, 0x4c)\n\truntime/mheap.go:1266 +0x3cc fp=0x267fbff7a0 sp=0x267fbff680 pc=0x7ff71641c9ac\nruntime.(*mheap).alloc.func1()\n\truntime/mheap.go:970 +0x6c fp=0x267fbff7f0 sp=0x267fbff7a0 pc=0x7ff71641c0cc\nruntime.(*mheap).alloc(0x0?, 0x0?, 0x0?)\n\truntime/mheap.go:964 +0x54 fp=0x267fbff840 sp=0x267fbff7f0 pc=0x7ff71641c034\nruntime.(*mcentral).grow(0x0?)\n\truntime/mcentral.go:254 +0x5c fp=0x267fbff880 sp=0x267fbff840 pc=0x7ff716405e7c\nruntime.(*mcentral).cacheSpan(0x7ff7175de1c0)\n\truntime/mcentral.go:170 +0x68c fp=0x267fbff950 sp=0x267fbff880 pc=0x7ff71640545c\nruntime.(*mcache).refill(...)\n\truntime/mcache.go:183\nruntime.(*mcache).nextFree(0x18829db05a0, 0x4c)\n\truntime/malloc.go:964 +0x218 fp=0x267fbff9c0 sp=0x267fbff950 pc=0x7ff716400468\nruntime.mallocgcSmallScanHeader(0x267fbffa58?, 0x7ff716dc3560, 0x1)\n\truntime/malloc.go:1464 +0x188 fp=0x267fbffa20 sp=0x267fbff9c0 pc=0x7ff716401378\nruntime.mallocgc(...)\n\truntime/malloc.go:1060\nruntime.newobject(0x7ff716dc3560)\n\truntime/malloc.go:1714 +0xb4 fp=0x267fbffa60 sp=0x267fbffa20 pc=0x7ff716401be4\nruntime.allocm(0x4000042a08, 0x7ff716e12350, 0x5)\n\truntime/proc.go:2233 +0x9c fp=0x267fbffac0 sp=0x267fbffa60 pc=0x7ff7164374ac\nruntime.newm(0x0?, 0x4000042a08, 0x267fbffb38?)\n\truntime/proc.go:2769 +0x44 fp=0x267fbffaf0 sp=0x267fbffac0 pc=0x7ff7164380f4\nruntime.startm(0x4000042a08?, 0x1, 0x0)\n\truntime/proc.go:2995 +0x140 fp=0x267fbffb40 sp=0x267fbffaf0 pc=0x7ff716438790\nruntime.wakep()\n\truntime/proc.go:3142 +0x174 fp=0x267fbffb70 sp=0x267fbffb40 pc=0x7ff716469d84\nruntime.resetspinning()\n\truntime/proc.go:3882 +0x74 fp=0x267fbffb90 sp=0x267fbffb70 pc=0x7ff71643bbf4\nruntime.schedule()\n\truntime/proc.go:4035 +0x108 fp=0x267fbffbd0 sp=0x267fbffb90 pc=0x7ff71643c0d8\nruntime.mstart1()\n\truntime/proc.go:1862 +0xd8 fp=0x267fbffc00 sp=0x267fbffbd0 pc=0x7ff7164368e8\nruntime.mstart0()\n\truntime/proc.go:1808 +0x68 fp=0x267fbffc30 sp=0x267fbffc00 pc=0x7ff7164367f8\nruntime.mstart()\n\truntime/asm_arm64.s:166 +0x10 fp=0x267fbffc40 sp=0x267fbffc30 pc=0x7ff71646eb40\n\ngoroutine 1 gp=0x400004c000 m=nil [chan receive, locked to thread]:\nruntime.gopark(0x4000053ec8?, 0x7ff716401bd0?, 0x8?, 0x1?, 0x80?)\n\truntime/proc.go:435 +0xc8 fp=0x4000053e60 sp=0x4000053e40 pc=0x7ff716469b58\nruntime.chanrecv(0x4000028180, 0x0, 0x1)\n\truntime/chan.go:664 +0x43c fp=0x4000053ee0 sp=0x4000053e60 pc=0x7ff7163f90cc\nruntime.chanrecv1(0x7ff716d50a20?, 0x2?)\n\truntime/chan.go:506 +0x14 fp=0x4000053f10 sp=0x4000053ee0 pc=0x7ff7163f8c54\nruntime.gcenable()\n\truntime/mgc.go:206 +0xb8 fp=0x4000053f40 sp=0x4000053f10 pc=0x7ff7164099f8\nruntime.main()\n\truntime/proc.go:211 +0x164 fp=0x4000053fd0 sp=0x4000053f40 pc=0x7ff7164332d4\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x4000053fd0 sp=0x4000053fd0 pc=0x7ff716471074\n\ngoroutine 2 gp=0x400004c700 m=nil [runnable]:\nruntime.forcegchelper()\n\truntime/proc.go:339 fp=0x400004ffd0 sp=0x400004ffd0 pc=0x7ff716433660\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x400004ffd0 sp=0x400004ffd0 pc=0x7ff716471074\ncreated by runtime.init.7 in goroutine 1\n\truntime/proc.go:336 +0x24\n\ngoroutine 3 gp=0x400004ca80 m=nil [runnable]:\nruntime.gcenable.gowrap1()\n\truntime/mgc.go:204 fp=0x4000051fd0 sp=0x4000051fd0 pc=0x7ff716409a90\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x4000051fd0 sp=0x4000051fd0 pc=0x7ff716471074\ncreated by runtime.gcenable in goroutine 1\n\truntime/mgc.go:204 +0x6c\n\ngoroutine 4 gp=0x400004cc40 m=nil [runnable]:\nruntime.gcenable.gowrap2()\n\truntime/mgc.go:205 fp=0x400005ffd0 sp=0x400005ffd0 pc=0x7ff716409a30\nruntime.goexit({})\n\truntime/asm_arm64.s:1260 +0x4 fp=0x400005ffd0 sp=0x400005ffd0 pc=0x7ff716471074\ncreated by runtime.gcenable in goroutine 1\n\truntime/mgc.go:205 +0xac\ngo: error obtaining buildID for go tool compile: exit status 2"},{"range":{"start":{"line":3,"character":1},"end":{"line":3,"character":19}},"severity":1,"code":"BrokenImport","codeDescription":{"href":"https://pkg.go.dev/golang.org/x/tools/internal/typesinternal#BrokenImport"},"source":"compiler","message":"could not import example.com/blah (missing metadata for import of \"example.com/blah\")"},{"range":{"start":{"line":4,"character":1},"end":{"line":4,"character":16}},"severity":1,"code":"BrokenImport","codeDescription":{"href":"https://pkg.go.dev/golang.org/x/tools/internal/typesinternal#BrokenImport"},"source":"compiler","message":"could not import mod.com/inner (missing metadata for import of \"mod.com/inner\")"},{"range":{"start":{"line":5,"character":1},"end":{"line":5,"character":17}},"severity":1,"code":"BrokenImport","codeDescription":{"href":"https://pkg.go.dev/golang.org/x/tools/internal/typesinternal#BrokenImport"},"source":"compiler","message":"could not import random.org/bye (missing metadata for import of \"random.org/bye\")"}]}


[Trace - 17:20:38.284 PM] Received notification '$/progress'.
Params: {"token":"156652029969887881","value":{"kind":"end","message":"Done."}}


#### End Gopls Test Logs for "TestClearAnalysisDiagnostics/default"
--- FAIL: TestClearAnalysisDiagnostics/default (5.13s)

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "windows" && goarch == "arm64" && (`fatal error: runtime: cannot allocate memory` || `fatal error: out of memory`)
2024-11-22 23:40 x_tools-gotip-windows-arm64 tools@51e54e89 go@c1a0ee37 x/tools/go/packages.TestIssue56632 (log)
=== RUN   TestIssue56632
=== PAUSE TestIssue56632
=== CONT  TestIssue56632
    invoke.go:205: starting GOROOT= GOPATH=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632 GO111MODULE=off GOPROXY= PWD=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632\src go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:205: 86.0396ms for GOROOT= GOPATH=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632 GO111MODULE=off GOPROXY= PWD=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632\src go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:205: starting GOROOT= GOPATH=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632 GO111MODULE=off GOPROXY= PWD=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632\src go list -e -json=Name,ImportPath,Error,Dir,CompiledGoFiles,Export -compiled=true -test=true -export=false -deps=false -find=false -pgo=off -- golang.org/issue56632/a
    invoke.go:205: 3.5995651s for GOROOT= GOPATH=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632 GO111MODULE=off GOPROXY= PWD=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632\src go list -e -json=Name,ImportPath,Error,Dir,CompiledGoFiles,Export -compiled=true -test=true -export=false -deps=false -find=false -pgo=off -- golang.org/issue56632/a
    invoke.go:205: starting GOROOT= GOPATH=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632 GO111MODULE=off GOPROXY= PWD=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632\src go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:205: 395.3327ms for GOROOT= GOPATH=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632 GO111MODULE=off GOPROXY= PWD=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632\src go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:205: starting GOROOT= GOPATH=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632 GO111MODULE=off GOPROXY= PWD=C:\Users\swarming\.swarming\w\ir\x\t\TestIssue566322303864441\issue56632\src go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export -compiled=true -test=true -export=false -deps=false -find=false -pgo=off -- golang.org/issue56632/a
...
        fatal error: out of memory
        
        runtime stack:
        runtime.throw({0x7ff7d51a7e71?, 0x4000328000?})
        	runtime/panic.go:1099 +0x38 fp=0xe8781ff830 sp=0xe8781ff800 pc=0x7ff7d4839ad8
        runtime.sysUsedOS(0x4000180000, 0x1ea000)
        	runtime/mem_windows.go:83 +0x178 fp=0xe8781ff890 sp=0xe8781ff830 pc=0x7ff7d47d6688
        runtime.sysUsed(...)
        	runtime/mem.go:77
        runtime.(*mheap).allocSpan(0x7ff7d5996a40, 0xf5, 0x0, 0x0)
...
        
        goroutine 6 gp=0x400004d180 m=nil [runnable]:
        runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
        	runtime/mgc.go:1794 fp=0x4000053fd0 sp=0x4000053fd0 pc=0x7ff7d47dd040
        runtime.goexit({})
        	runtime/asm_arm64.s:1260 +0x4 fp=0x4000053fd0 sp=0x4000053fd0 pc=0x7ff7d4841114
        created by unique.runtime_registerUniqueMapCleanup in goroutine 1
        	runtime/mgc.go:1794 +0x78
        go: error obtaining buildID for go tool compile: exit status 2
--- FAIL: TestIssue56632 (6.21s)

watchflakes

@dmitshur
Copy link
Contributor

The latest batch is resolved by restarting these. This is likely to happen again in about a month while the root issue (#66962) is unresolved.

@github-project-automation github-project-automation bot moved this from Active to Done in Test Flakes Nov 26, 2024
@dmitshur dmitshur added NeedsFix The path to resolution is known, but the work has not been done. and removed NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done.
Projects
Status: Done
Development

No branches or pull requests

4 participants