Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error sending empty batch on shutdown #27

Closed
zl4bv opened this issue Jul 1, 2020 · 0 comments
Closed

Error sending empty batch on shutdown #27

zl4bv opened this issue Jul 1, 2020 · 0 comments
Labels
bug Something isn't working

Comments

@zl4bv
Copy link

zl4bv commented Jul 1, 2020

I see the following error for each configured usage of the kinesis firehose plugin whenever fluent-bit shuts down.

It looks like the plugin is trying to flush any remaining records and attempts to send an empty batch. Not sure if my configuration needs to be adjusted or perhaps some additional validation in the plugin is needed to ensure a batch is only sent if it contains at least one record.

[engine] caught signal (SIGTERM)
[2020/06/30 06:11:45] [ info] [input] pausing tail.0
[2020/06/30 06:11:45] [ info] [input] pausing tail.1
[2020/06/30 06:11:45] [ info] [input] pausing tail.2
[2020/06/30 06:11:45] [ info] [input] pausing tail.3
[2020/06/30 06:11:45] [ info] [input] pausing tail.4
[2020/06/30 06:11:45] [ info] [input] pausing tail.5
[2020/06/30 06:11:45] [ warn] [engine] service will stop in 5 seconds
[engine] caught signal (SIGTERM)
[2020/06/30 06:11:45] [ warn] [engine] service will stop in 5 seconds
[2020/06/30 06:11:50] [ info] [engine] service stopped
time="2020-06-30T06:11:50Z" level=error msg="[firehose 0] PutRecordBatch failed with InvalidParameter: 1 validation error(s) found.\n- minimum field size of 1, PutRecordBatchInput.Records.\n"
time="2020-06-30T06:11:50Z" level=error msg="[firehose 0] InvalidParameter: 1 validation error(s) found.\n- minimum field size of 1, PutRecordBatchInput.Records.\n\n"

I'm running aws-for-fluent-bit 2.3.1 which is bundled with Fluent Bit 1.4.5 and Amazon Kinesis Firehose for Fluent Bit 1.2.1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants