Lab3(a) - 5c. Unable to activate fluent-plugin-elasticsearch-5.2.5, because faraday-2.12.0 conflicts

superman1

when I try to start up the Fluentd instance:
ubuntu@labsys:~/lab3$ fluentd -c ~/lab3/lab.conf

I get the following error message:
/usr/lib/ruby/vendor_ruby/rubygems/specification.rb:2312:in `raise_if_conflicts': Unable to activate fluent-plugin-elasticsearch-5.2.5, because faraday-2.12.0 conflicts with faraday (~> 1.10) (Gem::ConflictError)

What am I doing wrong?

superman1

I did the command:

sudo fluent-gem update

But now when I run Fluentd. I get the following errors:

/var/lib/gems/3.2.0/gems/fluent-plugin-elasticsearch-5.4.3/lib/fluent/plugin/elasticsearch_compat.rb:8: warning: already initialized constant TRANSPORT_CLASS
/var/lib/gems/3.2.0/gems/fluent-plugin-elasticsearch-5.4.3/lib/fluent/plugin/elasticsearch_compat.rb:3: warning: previous definition of TRANSPORT_CLASS was here
/var/lib/gems/3.2.0/gems/fluent-plugin-elasticsearch-5.4.3/lib/fluent/plugin/elasticsearch_compat.rb:26: warning: already initialized constant SELECTOR_CLASS
/var/lib/gems/3.2.0/gems/fluent-plugin-elasticsearch-5.4.3/lib/fluent/plugin/elasticsearch_compat.rb:21: warning: previous definition of SELECTOR_CLASS was here
The client is unable to verify that the server is Elasticsearch. Some functionality may not be compatible if the server is running an unsupported product.
2024-10-14 15:49:56 +0000 [error]: #0 unexpected error error_class=NoMethodError error="undefined method `transport' for #, @hosts=[{:host=>\"172.17.0.3\", :port=>9200, :scheme=>\"https\", :user=>\"elastic\", :password=>\"\", :protocol=>\"https\"}], @options={:reload_connections=>true, :reload_on_failure=>false, :resurrect_after=>60, :logger=>nil, :transport_options=>{:headers=>{\"Content-Type\"=>\"application/json\", \"User-Agent\"=>\"elasticsearch-ruby/7.17.11 (RUBY_VERSION: 3.2.3; linux x86_64; Faraday v2.12.0)\"}, :request=>{:timeout=>5}, :ssl=>{:verify=>false, :ca_file=>\"/home/ubuntuadmin/lab3/http_ca.crt\", :max_version=>772, :min_version=>771}}, :http=>{:user=>\"elastic\", :password=>\"\", :scheme=>:https}, :sniffer_class=>nil, :serializer_class=>nil, :selector_class=>nil, :compression=>false, :retry_on_status=>[], :delay_on_retry=>0}, @block=#, @compression=false, @user_agent=\"elasticsearch-ruby/7.17.11 (RUBY_VERSION: 3.2.3; linux x86_64; Faraday v2.12.0)\", @connections=#\"172.17.0.3\", :port=>9200, :scheme=>\"https\", :user=>\"elastic\", :password=>, :protocol=>\"https\"}, @connection=#\"Basic ZWxhc3RpYzo=\", \"Content-Type\"=>\"application/json\", \"User-Agent\"=>\"elasticsearch-ruby/7.17.11 (RUBY_VERSION: 3.2.3; linux x86_64; Faraday v2.12.0)\"}, @params={}, @options=#, @ssl=#, @default_parallel_manager=nil, @manual_proxy=false, @builder=#, @connection_options={:client_key=>nil, :client_cert=>nil, :client_key_pass=>nil, :nonblock=>true}, @config_block=nil, @connection=#1048576, :ciphers=>\"ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:DES-CBC3-SHA:!DSS\", :connect_timeout=>5, :debug_request=>false, :debug_response=>false, :dns_timeouts=>nil, :headers=>{\"User-Agent\"=>\"excon/0.112.0\", \"Accept\"=>\"/\"}, :idempotent=>false, :instrumentor_name=>\"excon\", :middlewares=>[Excon::Middleware::ResponseParser, Excon::Middleware::Expects, Excon::Middleware::Idempotent, Excon::Middleware::Instrumentor, Excon::Middleware::Mock], :mock=>false, :nonblock=>true, :omit_default_port=>false, :persistent=>false, :read_timeout=>5, :resolv_resolver=>nil, :retry_errors=>[Excon::Error::Timeout, Excon::Error::Socket, Excon::Error::HTTPStatus], :retry_limit=>4, :ssl_verify_peer=>false, :ssl_uri_schemes=>[\"https\"], :stubs=>:global, :tcp_nodelay=>false, :thread_safe_sockets=>true, :timeout=>nil, :uri_parser=>URI, :versions=>\"excon/0.112.0 (x86_64-linux-gnu) ruby/3.2.3\", :write_timeout=>5, :host=>\"172.17.0.3\", :hostname=>\"172.17.0.3\", :path=>\"\", :port=>9200, :query=>nil, :scheme=>\"https\", :ssl_ca_file=>\"/home/ubuntuadmin/lab3/http_ca.crt\", :ssl_min_version=>771, :ssl_max_version=>772, :client_key=>nil, :client_cert=>nil, :client_key_pass=>nil, :password=>\"REDACTED\", :user=>\"elastic\"} @socket_key=\"https://172.17.0.3:9200\" @_excon_sockets={#=>{}} @persistent_socket_reusable=true>>>, @url_prefix=#, @proxy=nil>, @options={:resurrect_timeout=>60}, @verified=false, @state_mutex=#, @dead=false, @failures=0>], @selector=#, @mutex=#, @current=0>>, @serializer=#>, @protocol=\"http\", @logger=nil, @tracer=nil, @sniffer=#, @timeout=1>, @counter=1, @counter_mtx=#, @last_request_at=2024-10-14 15:49:56.806625725 +0000, @reload_connections=true, @reload_after=10000, @resurrect_after=60, @retry_on_status=[]>"
............ had to remote to make post ................

2024-10-14 15:49:56 +0000 [error]: #0 /usr/local/bin/fluentd:25:in load' 2024-10-14 15:49:56 +0000 [error]: #0 /usr/local/bin/fluentd:25:in

'
2024-10-14 15:49:56 +0000 [info]: Worker 0 finished with status 1

What am I missing here? I have tired to update the gems. I still cannot figure out why after the section.
5c. Configure Fluentd for the NGINX to Elsticsearch pipeline things are not working.

I have followed the: ubuntu@labsys:~/lab3$ vi lab.conf

Updated the file.

Then in another terminal I run:
ubuntu@labsys:~/lab3$ fluentd -c ~/lab3/lab.conf