[BUG] Failed to submit a listener notification task. Event loop shut down? #4441
Comments
|
Hi guys, I have fixed this problem. As you can see in the data-prepper.log, there are tons of the error below: Investigating a bit more I found out this post. Then, everything is working. This is my implementation for Fluentbit. luaScripts:
dedot_file.lua: |
function dedot_function(tag, timestamp, record)
if record["kubernetes"] == nil then
return 0, 0, 0
end
dedot_keys(record["kubernetes"]["annotations"])
dedot_keys(record["kubernetes"]["labels"])
return 1, timestamp, record
end
function dedot_keys(map)
if map == nil then
return
end
local new_map = {}
local changed_keys = {}
for k, v in pairs(map) do
local deslashed = string.gsub(k, "%/", "_")
local dedotted = string.gsub(deslashed, "%.", "_")
if dedotted ~= k then
new_map[dedotted] = v
changed_keys[k] = true
end
end
for k in pairs(changed_keys) do
map[k] = nil
end
for k, v in pairs(new_map) do
map[k] = v
end
end
## https://docs.fluentbit.io/manual/pipeline/inputs
config:
inputs: |
[INPUT]
Name tail
Path /var/log/containers/*.log
multiline.parser docker, cri
Tag kube.*
Mem_Buf_Limit 5MB
Skip_Long_Lines On
[INPUT]
Name systemd
Tag host.*
Systemd_Filter _SYSTEMD_UNIT=kubelet.service
Read_From_Tail On
## https://docs.fluentbit.io/manual/pipeline/filters
filters: |
[FILTER]
Name kubernetes
Match kube.*
Merge_Log On
Keep_Log Off
K8S-Logging.Parser On
K8S-Logging.Exclude On
[FILTER]
Name lua
Match *
script /fluent-bit/scripts/dedot_file.lua
call dedot_function
## https://docs.fluentbit.io/manual/pipeline/outputs
outputs: |
# Print in the console
#[OUTPUT]
# Name stdout
# Match *
[OUTPUT]
Name http
Match *
Host data-prepper-headless
Port 21890
URI /log/ingest
Format json |
github-project-automation
bot
moved this from Unplanned
to Done
in Data Prepper Tracking Board
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hello everyone,
Can I have a hand on this error? For some reason, I started having this problem below:
I even have no idea where to start investigating. This is my pipeline:
And this is the full stack error:
Just in case, here is the complete data-prepper.log
I appreciate any help in advance.
The text was updated successfully, but these errors were encountered: