Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fluent-bit Crash at startup #704

Closed
yubobo opened this issue Aug 6, 2018 · 5 comments
Closed

fluent-bit Crash at startup #704

yubobo opened this issue Aug 6, 2018 · 5 comments

Comments

@yubobo
Copy link

yubobo commented Aug 6, 2018

Error is as follows:

[2018/08/06 07:45:14] [debug] [in_tail] add to scan queue /buffalo/3982769_action.5953765.log, offset=7919
[2018/08/06 07:45:14] [debug] [in_tail] add to scan queue /buffalo/3982793_action.5953813.log, offset=7919
[2018/08/06 07:45:14] [debug] [in_tail] add to scan queue /buffalo/3982828_action.5953878.log, offset=7919
[2018/08/06 07:45:14] [debug] [in_tail] add to scan queue /buffalo/3982836_action.5953894.log, offset=7919
[2018/08/06 07:45:14] [debug] [in_tail] add to scan queue /buffalo/3982844_action.5953910.log, offset=7919
[2018/08/06 07:45:14] [debug] [in_tail] add to scan queue /buffalo/3982852_action.5953929.log, offset=7919
[2018/08/06 07:45:14] [debug] [in_tail] add to scan queue /buffalo/3982869_action.5953962.log, offset=7919
[2018/08/06 07:45:14] [debug] [in_tail] add to scan queue /buffalo/3982877_action.5953978.log, offset=7919
[engine] caught signal (SIGTERM)
[engine] caught signal (SIGSEGV)
[2018/08/06 07:45:14] [ info] [input] pausing tail.0
Fluent-Bit v0.13.4
Copyright (C) Treasure Data

#0 0x7f835a6518ba in in_tail_pause() at plugins/in_tail/tail.c:301
#1 0x7f835a62d853 in flb_input_pause_all() at src/flb_input.c:633
#2 0x7f835a6356b0 in flb_engine_exit() at src/flb_engine.c:615
#3 0x7f835a5d43db in flb_signal_handler() at src/fluent-bit.c:233
#4 0x7f8358de705f in ???() at ???:0
#5 0x7f835a75b469 in btreeParseCellPtr() at lib/sqlite-amalgamation-3230000/sqlite3.c:62731
#6 0x7f835a75b755 in btreeParseCell() at lib/sqlite-amalgamation-3230000/sqlite3.c:62820
#7 0x7f835a7602bd in getCellInfo() at lib/sqlite-amalgamation-3230000/sqlite3.c:65983
#8 0x7f835a760313 in sqlite3BtreePayloadSize() at lib/sqlite-amalgamation-3230000/sqlite3.c:66044
#9 0x7f835a778ad8 in sqlite3VdbeExec() at lib/sqlite-amalgamation-3230000/sqlite3.c:83702
#10 0x7f835a773ded in sqlite3Step() at lib/sqlite-amalgamation-3230000/sqlite3.c:79579
#11 0x7f835a77403b in sqlite3_step() at lib/sqlite-amalgamation-3230000/sqlite3.c:79642
#12 0x7f835a7a9ea4 in sqlite3_exec() at lib/sqlite-amalgamation-3230000/sqlite3.c:114700
#13 0x7f835a69aee4 in flb_sqldb_query() at src/flb_sqldb.c:119
#14 0x7f835a657271 in flb_tail_db_file_set() at plugins/in_tail/tail_db.c:104
#15 0x7f835a65351c in flb_tail_file_append() at plugins/in_tail/tail_file.c:517
#16 0x7f835a655fe3 in flb_tail_scan() at plugins/in_tail/tail_scan.c:259
#17 0x7f835a65165e in in_tail_init() at plugins/in_tail/tail.c:206
#18 0x7f835a62ce5d in flb_input_initialize_all() at src/flb_input.c:298
#19 0x7f835a634f60 in flb_engine_start() at src/flb_engine.c:417
#20 0x7f835a5d5606 in main() at src/fluent-bit.c:824
#21 0x7f8358dd42e0 in ???() at ???:0
#22 0x7f835a5d3a89 in ???() at ???:0
#23 0xffffffffffffffff in ???() at ???:0

@yubobo
Copy link
Author

yubobo commented Aug 6, 2018

fluent-bit:0.13.4

@yubobo
Copy link
Author

yubobo commented Aug 6, 2018

input-logfile.conf: |
[INPUT]
Name tail
Tag buffalo
Path /buffalo/*.log
DB /fluent-bit/fileDB/flb_buffalo_log.db
Mem_Buf_Limit 10MB
Skip_Long_Lines Off
Refresh_Interval 5

output-kafka.conf: |
[OUTPUT]
Name kafka
Match buffalo
Brokers 10.196.99.71:9292,10.196.99.72:9292,10.196.99.73:9292,10.196.99.74:9292,10.196.99.75:9292,10.196.99.76:9292,10.196.99.98:9292,10.196.99.99:9292,10.196.99.100:9292,10.196.99.101:9292,10.196.99.102:9292,10.196.99.103:9292,10.196.99.104:9292
Topics buffalo-log-k8s-test
Timestamp_Key @timestamp
Retry_Limit 3
rdkafka.log.connection.close false
rdkafka.queue.buffering.max.ms 1000
rdkafka.queue.buffering.max.messages 50000
rdkafka.batch.num.messages 10000
rdkafka.compression.codec snappy
rdkafka.request.required.acks 1

@yubobo yubobo closed this as completed Aug 11, 2018
@edsiper
Copy link
Member

edsiper commented Aug 11, 2018

would you please run fluent bit under valgrind ?

@edsiper edsiper reopened this Aug 11, 2018
@yubobo
Copy link
Author

yubobo commented Aug 18, 2018

The scan queue is more and more longer by time, it would burn up the fs.inotify.max_user_watches.
this the reason of "No space left on device".

@yubobo yubobo closed this as completed Aug 18, 2018
@Pareshdl
Copy link

I'm getting below error while starting fluent bit by using firelens

[2020/12/11 10:27:14] [ info] [input] pausing forward.0
[2020/12/11 10:27:14] [ info] [input] pausing forward.0
2020-12-11T15:57:14.101+05:30 [2020/12/11 10:27:14] [ info] [input] pausing forward.1
2020-12-11T15:57:14.101+05:30 [2020/12/11 10:27:14] [ warn] [engine] service will stop in 5 seconds
[2020/12/11 10:27:18] [ info] [engine] service stopped

rawahars pushed a commit to rawahars/fluent-bit that referenced this issue Oct 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants