Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

stats: spam of buffered channel is full. Unable to refresh stats for table X #36416

Closed
tbg opened this issue Apr 2, 2019 · 0 comments
Closed

stats: spam of buffered channel is full. Unable to refresh stats for table X #36416

tbg opened this issue Apr 2, 2019 · 0 comments
Assignees
@rytaft
Milestone
19.1

Comments

@tbg
Copy link
Member

tbg commented Apr 2, 2019 •
edited
Loading 

W190401 21:17:11.812311 3824 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812372 3749 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812313 3370 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812548 1848 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812557 3517 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812562 3814 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812637 3731 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812746 4247 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812852 2789 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.812921 4243 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 57 with 1 rows affected
W190401 21:17:11.813077 4044 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.813231 3921 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.813529 3459 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.813639 2802 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.813754 4197 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.813867 2155 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814018 3842 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814094 3403 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814159 4166 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814220 3770 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814282 4039 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814329 3693 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814337 3556 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814376 3382 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814537 3096 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814600 3747 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814608 4200 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814708 3703 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.814884 3665 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 53 with 1 rows affected
W190401 21:17:11.815078 3526 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 57 with 1 rows affected
W190401 21:17:11.815147 3441 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.815424 3611 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 60 with 15 rows affected
W190401 21:17:11.815663 3953 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 59 with 7 rows affected
W190401 21:17:11.816301 3867 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.816553 3363 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.816621 1774 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected
W190401 21:17:11.816673 3480 sql/stats/automatic_stats.go:360  buffered channel is full. Unable to refresh stats for table 54 with 1 rows affected

Seen in this file #36397 (comment)

The frequency of these messages is high. They need rate limiting.
@RaduBerinde RaduBerinde assigned rytaft and unassigned RaduBerinde Apr 2, 2019
@RaduBerinde RaduBerinde added this to the 19.1 milestone Apr 2, 2019
rytaft added a commit to rytaft/cockroach that referenced this issue Apr 2, 2019
@rytaft
stats: don't spam log with warning messages
a6be7ed 
This commit adds a log limiter so that "buffered channel is full"
errors are printed at most once per second per node.

Fixes cockroachdb#36416

Release note: None
@rytaft rytaft mentioned this issue Apr 2, 2019
Merged
craig bot pushed a commit that referenced this issue Apr 2, 2019
@rytaft
Merge #36429
5908b42 
36429: stats: don't spam log with warning messages r=rytaft a=rytaft

This commit adds a log limiter so that "buffered channel is full"
errors are printed at most once per second per node.

Fixes #36416

Release note: None

Co-authored-by: Rebecca Taft <[email protected]>
@craig craig bot closed this as completed in #36429 Apr 2, 2019
rytaft added a commit to rytaft/cockroach that referenced this issue Apr 2, 2019
@rytaft
stats: don't spam log with warning messages
1a7e6e4 
This commit adds a log limiter so that "buffered channel is full"
errors are printed at most once per second per node.

Fixes cockroachdb#36416

Release note: None
@rytaft rytaft mentioned this issue Apr 2, 2019
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rytaft rytaft

Labels
None yet
Projects
None yet
Milestone
19.1
Development

No branches or pull requests
3 participants
@rytaft @tbg @RaduBerinde