Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to configure storm-helm chart with 3 supervisors and 2 nimbus pods? #87

Open
pratikch opened this issue Feb 2, 2023 · 0 comments
Open

Comments

@pratikch
Copy link

pratikch commented Feb 2, 2023

I've helm chart with 2 nimbus in statefulset and 3 supervisors in deployment.
Supervisor containers are failing to start because of this following error...

│ waiting for helmstorm-nimbus.pkstorm                                                                                                                                                                                                       
 Running: /usr/lib/jvm/jre/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/opt/apache-storm -Dstorm.log.dir=/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/lib64 -Dstorm.conf.file= -cp /opt/apache-s 
 23:57:16.269 [main] INFO  o.a.s.v.ConfigValidation - Will use [class org.apache.storm.DaemonConfig, class org.apache.storm.Config] for validation                                                                                          
 23:57:16.443 [main] INFO  o.a.s.u.NimbusClient - Found leader nimbus : helmstorm-nimbus-0.helmstorm-nimbus:6627                                                                                                                            
 23:57:26.504 [main] WARN  o.a.s.u.NimbusClient - Ignoring exception while trying to get leader nimbus info from helmstorm-nimbus.pkstorm. will retry with a different seed host.                                                           
 java.lang.RuntimeException: java.lang.RuntimeException: org.apache.storm.thrift.transport.TTransportException: java.net.UnknownHostException: helmstorm-nimbus-0.helmstorm-nimbus                                                          
     at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:108) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                                        
     at org.apache.storm.security.auth.ThriftClient.<init>(ThriftClient.java:69) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                                            
     at org.apache.storm.utils.NimbusClient.<init>(NimbusClient.java:80) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                                                    
     at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:234) [storm-client-2.4.0.jar:2.4.0]                                                                                                                     
     at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:179) [storm-client-2.4.0.jar:2.4.0]                                                                                                                     
     at org.apache.storm.utils.NimbusClient.withConfiguredClient(NimbusClient.java:127) [storm-client-2.4.0.jar:2.4.0]                                                                                                                      
     at org.apache.storm.utils.NimbusClient.withConfiguredClient(NimbusClient.java:117) [storm-client-2.4.0.jar:2.4.0]                                                                                                                      
     at org.apache.storm.command.ListTopologies.main(ListTopologies.java:27) [storm-core-2.4.0.jar:2.4.0]                                                                                                                                   
 Caused by: java.lang.RuntimeException: org.apache.storm.thrift.transport.TTransportException: java.net.UnknownHostException: helmstorm-nimbus-0.helmstorm-nimbus                                                                           
     at org.apache.storm.security.auth.TBackoffConnect.retryNext(TBackoffConnect.java:59) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                                   
     at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:51) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                          
     at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:98) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                                         
     ... 7 more                                                                                                                                                                                                                             
 Caused by: org.apache.storm.thrift.transport.TTransportException: java.net.UnknownHostException: helmstorm-nimbus-0.helmstorm-nimbus                                                                                                       
     at org.apache.storm.thrift.transport.TSocket.open(TSocket.java:226) ~[storm-shaded-deps-2.4.0.jar:2.4.0]                                                                                                                               
     at org.apache.storm.thrift.transport.TFramedTransport.open(TFramedTransport.java:91) ~[storm-shaded-deps-2.4.0.jar:2.4.0]                                                                                                              
     at org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:101) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                        
     at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:48) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                          
     at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:98) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                                         
     ... 7 more                                                                                                                                                                                                                             
 Caused by: java.net.UnknownHostException: helmstorm-nimbus-0.helmstorm-nimbus                                                                                                                                                              
     at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) ~[?:1.8.0_322]                                                                                                                                           
     at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_322]                                                                                                                                                           
     at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_322]                                                                                                                                                                             
     at org.apache.storm.thrift.transport.TSocket.open(TSocket.java:221) ~[storm-shaded-deps-2.4.0.jar:2.4.0]                                                                                                                               
     at org.apache.storm.thrift.transport.TFramedTransport.open(TFramedTransport.java:91) ~[storm-shaded-deps-2.4.0.jar:2.4.0]                                                                                                              
     at org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:101) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                        
     at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:48) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                          
     at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:98) ~[storm-client-2.4.0.jar:2.4.0]                                                                                                                         
     ... 7 more                                                                                                                                                                                                                             
 Exception in thread "main" org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [helmstorm-nimbus.pkstorm]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?            
     at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:250)                                                                                                                                                    
     at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:179)                                                                                                                                                    
     at org.apache.storm.utils.NimbusClient.withConfiguredClient(NimbusClient.java:127)                                                                                                                                                     
     at org.apache.storm.utils.NimbusClient.withConfiguredClient(NimbusClient.java:117)                                                                                                                                                     
     at org.apache.storm.command.ListTopologies.main(ListTopologies.java:27)

Can you guide me how can I configure the storm cluster correctly?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant