tg-agent 4.4.1-1 version not running on Ubuntu 22.04

[vikranth06]

Hi All,

We have installed tg-agent 4.4.1-1 version on Ubuntu 22.04 and its not running at all, below error is thrown:
td-agent -vv
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: parsing config file is succeeded path="/etc/td-agent/td-agent.conf"
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluentd' version '1.14.6'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-aws-elasticsearch-service' version '2.4.1'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-calyptia-monitoring' version '0.1.3'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-elasticsearch' version '5.2.2'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-elasticsearch' version '5.1.4'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-elasticsearch' version '4.1.1'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-elasticsearch' version '3.8.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-flowcounter-simple' version '0.1.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-json-transform' version '0.0.2'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-kafka' version '0.17.5'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-mail' version '0.3.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-metrics-cmetrics' version '0.1.2'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-opensearch' version '1.0.8'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-opensearch' version '1.0.4'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-prometheus' version '2.0.2'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-prometheus_pushgateway' version '0.1.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-record-modifier' version '2.1.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-rewrite-tag-filter' version '2.4.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-s3' version '1.6.1'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-sd-dns' version '0.1.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-systemd' version '1.0.5'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-td' version '1.1.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-utmpx' version '0.5.0'
2022-09-27 10:47:56 +0000 [info]: fluent/log.rb:330:info: gem 'fluent-plugin-webhdfs' version '1.5.0'
2022-09-27 10:47:56 +0000 [trace]: fluent/log.rb:287:trace: registered output plugin 'mail'
2022-09-27 10:47:56 +0000 [trace]: fluent/log.rb:287:trace: registered metrics plugin 'local'
2022-09-27 10:47:56 +0000 [trace]: fluent/log.rb:287:trace: registered output plugin 'null'
2022-09-27 10:47:56 +0000 [trace]: fluent/log.rb:287:trace: registered buffer plugin 'memory'
2022-09-27 10:47:57 +0000 [trace]: fluent/log.rb:287:trace: registered output plugin 'tdlog'
2022-09-27 10:47:57 +0000 [trace]: fluent/log.rb:287:trace: registered buffer plugin 'file'
2022-09-27 10:47:57 +0000 [trace]: fluent/log.rb:287:trace: registered output plugin 'file'
2022-09-27 10:47:57 +0000 [trace]: fluent/log.rb:287:trace: registered formatter plugin 'out_file'
2022-09-27 10:47:57 +0000 [warn]: fluent/log.rb:351:warn: Use different plugin for secondary. Check the plugin works with primary like secondary_file primary="Fluent::Plugin::TreasureDataLogOutput" secondary="Fluent::Plugin::FileOutput"
2022-09-27 10:47:57 +0000 [trace]: fluent/log.rb:287:trace: registered output plugin 'copy'
2022-09-27 10:47:57 +0000 [debug]: fluent/log.rb:309:debug: adding store type="aws-elasticsearch-service"
2022-09-27 10:47:57 +0000 [trace]: fluent/log.rb:287:trace: registered output plugin 'elasticsearch'
2022-09-27 10:47:57 +0000 [trace]: fluent/log.rb:287:trace: registered output plugin 'aws-elasticsearch-service'
/opt/td-agent/lib/ruby/gems/3.1.0/gems/fluent-plugin-aws-elasticsearch-service-2.4.1/lib/fluent/plugin/out_aws-elasticsearch-service.rb:144:in include': wrong argument type Class (expected Module) (TypeError) from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluent-plugin-aws-elasticsearch-service-2.4.1/lib/fluent/plugin/out_aws-elasticsearch-service.rb:144:in module:Client'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluent-plugin-aws-elasticsearch-service-2.4.1/lib/fluent/plugin/out_aws-elasticsearch-service.rb:143:in <module:Elasticsearch>' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluent-plugin-aws-elasticsearch-service-2.4.1/lib/fluent/plugin/out_aws-elasticsearch-service.rb:141:in class:ElasticsearchOutput'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluent-plugin-aws-elasticsearch-service-2.4.1/lib/fluent/plugin/out_aws-elasticsearch-service.rb:140:in <module:Plugin>' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluent-plugin-aws-elasticsearch-service-2.4.1/lib/fluent/plugin/out_aws-elasticsearch-service.rb:9:in <top (required)>'
from internal:/opt/td-agent/lib/ruby/3.1.0/rubygems/core_ext/kernel_require.rb:85:in require' from <internal:/opt/td-agent/lib/ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:85:in require'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/registry.rb:103:in block in search' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/registry.rb:100:in each'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/registry.rb:100:in search' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/registry.rb:44:in lookup'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/plugin.rb:169:in new_impl' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/plugin.rb:114:in new_output'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/plugin/multi_output.rb:108:in block in configure' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/plugin/multi_output.rb:99:in each'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/plugin/multi_output.rb:99:in configure' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/plugin/out_copy.rb:39:in configure'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/plugin.rb:187:in configure' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/agent.rb:132:in add_match'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/agent.rb:74:in block in configure' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/agent.rb:64:in each'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/agent.rb:64:in configure' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/root_agent.rb:149:in configure'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/engine.rb:105:in configure' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/engine.rb:80:in run_configure'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/supervisor.rb:668:in run_supervisor' from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/lib/fluent/command/fluentd.rb:356:in <top (required)>'
from internal:/opt/td-agent/lib/ruby/3.1.0/rubygems/core_ext/kernel_require.rb:85:in require' from <internal:/opt/td-agent/lib/ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:85:in require'
from /opt/td-agent/lib/ruby/gems/3.1.0/gems/fluentd-1.14.6/bin/fluentd:15:in <top (required)>' from /opt/td-agent/bin/fluentd:25:in load'
from /opt/td-agent/bin/fluentd:25:in <top (required)>' from /usr/sbin/td-agent:15:in load'
from /usr/sbin/td-agent:15:in `

'

Details of td-agent are:
apt show td-agent
Package: td-agent
Version: 4.4.1-1
Priority: optional
Section: net
Maintainer: Fluentd developers [email protected]
Installed-Size: 72.0 MB
Pre-Depends: adduser
Depends: libc6 (>= 2.35), libcrypt1 (>= 1:4.1.0), libgmp10 (>= 2:6.2.1+dfsg), libssl3 (>= 3.0.0~~alpha1), libyaml-0-2, zlib1g (>= 1:1.2.2)
Homepage: https://www.fluentd.org/
Download-Size: 11.8 MB
APT-Sources: https://packages.treasuredata.com/4/ubuntu/jammy jammy/contrib amd64 Packages
Description: Treasure Agent: A data collector for Treasure Data
Treasure Agent is all in one package which contains Fluentd and
related gem packages.
.
It is installable alongside with system's gem packages separately.

N: There are 3 additional records. Please use the '-a' switch to see them.

We tried to install 4.3 too, but the error message remains the same.

Please help us in resolving this issue.

[vikranth06]

any help on this???

[cosmo0920]

Any chance to migrate from fluent-plugin-aws-elasticsearch-service to fluent-plugin-opnesearch? fluent-plugin-aws-elasticsearch-service is now deprecated and @atomita is inactive for now.

[vikranth06]

migrated to opensearch plugin but getting this error now "2022-10-11 13:33:36 +0000 [error]: #0 unexpected error error_class=ArgumentError error="expected both :access_key_id and :secret_access_key options""
We have provided both the values (secret & access key) but still getting the error.