-
Notifications
You must be signed in to change notification settings - Fork 3.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
kvserver: log when raft send/recv queue fills up #86645
Conversation
Inspired by cockroachlabs/support#1770. If either the raft send or receive queue fills up, wide-spread outages can occur as replication progress stalls. We have metrics that can indicate this, but straightforward logging is also appropriate to direct attention to the fact, which this commit achieves. Touches cockroachdb#79755 Release justification: important logging improvement Release note: None
TFTRs! |
Build failed (retrying...): |
Build failed (retrying...): |
Build failed: |
bors r=pavelkalinnikov |
Build succeeded: |
blathers backport 21.2 |
Encountered an error creating backports. Some common things that can go wrong:
You might need to create your backport manually using the backport tool. error creating merge commit from c1cd955 to blathers/backport-release-21.2-86645: POST https://api.github.com/repos/cockroachdb/cockroach/merges: 409 Merge conflict [] you may need to manually resolve merge conflicts with the backport tool. Backport to branch 21.2 failed. See errors above. 🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is otan. |
blathers backport 22.1 |
Encountered an error creating backports. Some common things that can go wrong:
You might need to create your backport manually using the backport tool. error creating merge commit from c1cd955 to blathers/backport-release-22.1-86645: POST https://api.github.com/repos/cockroachdb/cockroach/merges: 409 Merge conflict [] you may need to manually resolve merge conflicts with the backport tool. Backport to branch 22.1 failed. See errors above. 🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is otan. |
Inspired by https://github.com/cockroachlabs/support/issues/1770.
If either the raft send or receive queue fills up, wide-spread outages
can occur as replication progress stalls. We have metrics that can
indicate this, but straightforward logging is also appropriate to direct
attention to the fact, which this commit achieves.
Touches #79755
Release justification: important logging improvement
Release note: None