Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory leaks in post-process-forwarder-transactions #3444

Open
doc-sheet opened this issue Nov 21, 2024 · 4 comments
Open

Memory leaks in post-process-forwarder-transactions #3444

doc-sheet opened this issue Nov 21, 2024 · 4 comments

Comments

@doc-sheet
Copy link

Self-Hosted Version

24.10.0

CPU Architecture

x86_64

Docker Version

20.10.17

Docker Compose Version

none

Steps to Reproduce

  1. Run post-process-forwarder-transactions with multiple processes
sentry run consumer --no-strict-offset-reset post-process-forwarder-transactions --consumer-group=post-process-forwarder --synchronize-commit-log-topic=snuba-transactions-commit-log --synchronize-commit-group=transactions_group -- --processes 4 --concurrency 4
  1. Wait

Expected Result

Normal work just as any other consumer

Actual Result

Consumer being stopped by oom-killer.

I tried different limits - but if only delays inevitable OOM.

There are no logs in between "Starting multithreaded post process forwarder" and crash.

Event ID

No response

@doc-sheet
Copy link
Author

Sorry if wrong project, I just unsure if issue in my setup or sentry itself.

@bc-sentry bc-sentry transferred this issue from getsentry/self-hosted Nov 25, 2024
@getsantry
Copy link

getsantry bot commented Nov 25, 2024

Routing to @getsentry/product-owners-ingestion-and-filtering for triage ⏲️

@getsantry
Copy link

getsantry bot commented Nov 25, 2024

Assigning to @getsentry/support for routing ⏲️

@InterstellarStella InterstellarStella transferred this issue from getsentry/sentry Nov 26, 2024
@getsantry getsantry bot moved this from Waiting for: Support to Waiting for: Product Owner in GitHub Issues with 👀 3 Nov 26, 2024
@aldy505
Copy link
Collaborator

aldy505 commented Dec 9, 2024

Nothing we can do in self-hosted. Should be transferred to sentry for triage. cc @bc-sentry

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Status: No status
Development

No branches or pull requests

2 participants