Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

projectconfig.LoadOrCreate spamming the message "Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml" #1872

Closed
wesbillman opened this issue Jun 25, 2024 · 2 comments
Labels
triage Issue needs triaging

Comments

@wesbillman
Copy link
Collaborator

When I run via the VSCode extension with --log-level=trace I see these messages filling the output window. This also seems to cause the CPU usage for ftl process to spike to 150% or so on my machine. Here's a snapshot of the output I see:

trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (unary)
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:func8: Running scheduled task
trace:func9: Running scheduled task
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (unary)
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (unary)
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml
trace:controller0: Loading config from /Users/wesbillman/dev/ftl/ftl-project.toml

I can also see a bunch of these messages when I run outside of VSCode (from terminal do ftl dev --recreate --log-level=trace):

trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
trace:controller0: /xyz.block.ftl.v1.VerbService/GetModuleContext (streaming handler)
@github-actions github-actions bot added the triage Issue needs triaging label Jun 25, 2024
@ftl-robot ftl-robot mentioned this issue Jun 25, 2024
@safeer
Copy link
Contributor

safeer commented Jun 27, 2024

I'm seeing this when running ftl-controller, so it might be due to missing aws creds for asm?

debug:lease:/system/scheduledtask/reapStaleRunners: Acquired lease
warn: Unable to sync asm-leader: unable to get list of secrets from ASM: operation error Secrets Manager: ListSecrets, get identity: get credentials: failed to refresh cached credentials, no EC2 IMDS role found, operation error ec2imds: GetMetadata, exceeded maximum number of attempts, 3, request send failed, Get "http://169.254.169.254/latest/meta-data/iam/security-credentials/": dial tcp 169.254.169.254:80: connect: host is down
debug: Streaming RPC failed: internal: could not get secrets: secrets not synced for asm-leader yet: /xyz.block.ftl.v1.VerbService/GetModuleContext
debug: Streaming RPC failed: internal: could not get secrets: secrets not synced for asm-leader yet: /xyz.block.ftl.v1.VerbService/GetModuleContext
debug: Streaming RPC failed: internal: could not get secrets: secrets not synced for asm-leader yet: /xyz.block.ftl.v1.VerbService/GetModuleContext
debug: Streaming RPC failed: internal: could not get secrets: secrets not synced for asm-leader yet: /xyz.block.ftl.v1.VerbService/GetModuleContext
debug: Streaming RPC failed: internal: could not get secrets: secrets not synced for asm-leader yet: /xyz.block.ftl.v1.VerbService/GetModuleContext
debug: Streaming RPC failed: internal: could not get secrets: secrets not synced for asm-leader yet: /xyz.block.ftl.v1.VerbService/GetModuleContext
debug: Streaming RPC failed: internal: could not get secrets: secrets not synced for asm-leader yet: /xyz.block.ftl.v1.VerbService/GetModuleContext

@wesbillman
Copy link
Collaborator Author

There was a bug recently that cause GetModuleContext to get called a bunch. I wonder if things are better now after that was fixed? Are you seeing this on the latest main @safeer ?

@matt2e matt2e closed this as completed Jul 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
triage Issue needs triaging
Projects
None yet
Development

No branches or pull requests

3 participants