Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make aggregation log statements debug level #78

Closed
jtackaberry opened this issue Oct 7, 2020 · 2 comments
Closed

Make aggregation log statements debug level #78

jtackaberry opened this issue Oct 7, 2020 · 2 comments
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@jtackaberry
Copy link

#16 was implemented (yay!) but Fluent Bit is now extremely verbose at info level:

time="2020-10-07T02:03:18Z" level=info msg="[kinesis ] Aggregated (1) records of size (895) with total size (895), partition key (cyWNsWj6)\n"
time="2020-10-07T02:03:23Z" level=info msg="[kinesis ] Aggregated (1) records of size (895) with total size (895), partition key (6pSaIX1r)\n"
time="2020-10-07T02:03:28Z" level=info msg="[kinesis ] Aggregated (1) records of size (895) with total size (895), partition key (GDBDb6IS)\n"
time="2020-10-07T02:03:33Z" level=info msg="[kinesis ] Aggregated (1) records of size (895) with total size (895), partition key (hgQY6LMV)\n"
time="2020-10-07T02:03:38Z" level=info msg="[kinesis ] Aggregated (1) records of size (895) with total size (895), partition key (k1FaRX9X)\n"

One imagines at higher load these lines would accumulate quickly. Perhaps this should be logged at debug?

@PettitWesley
Copy link
Contributor

@jtackaberry Good idea

@PettitWesley PettitWesley added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed labels Oct 11, 2020
@PettitWesley PettitWesley changed the title Aggregation logs are very spammy Make aggregation log statements debug level Oct 11, 2020
@zhonghui12
Copy link
Contributor

It is released as part of https://github.com/aws/aws-for-fluent-bit/releases/tag/v2.9.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants