[Backlogmanager] [FIWARE-JIRA] (HELP-20090) [fiware-stackoverflow] Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper

[Andres Muñoz (JIRA)]

    [ https://jira.fiware.org/browse/HELP-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=116080#comment-116080 ] 

Andres Muñoz commented on HELP-20090:
-------------------------------------

It seems to be more related to nifi instead of draco, redirected to the NiFi community for help

> [fiware-stackoverflow] Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper
> --------------------------------------------------------------------------------------------------
>
>                 Key: HELP-20090
>                 URL: https://jira.fiware.org/browse/HELP-20090
>             Project: Help-Desk
>          Issue Type: Monitor
>          Components: FIWARE-TECH-HELP
>            Reporter: Backlog Manager
>            Assignee: Andres Muñoz
>              Labels: apache-nifi, apache-zookeeper, cluster-computing, fiware, open-source
>
> Created question in FIWARE Q/A platform on 23-09-2022 at 10:09
> {color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/73826331/using-fiware-draco-2-1-0-how-to-setup-nifi-cluster-using-external-zookeeper
> +Question:+
> Using Fiware Draco 2.1.0 How to setup NiFi cluster using external zookeeper
> +Description:+
> I'm trying to set up a NiFi cluster using an external zookeeper version is 3.4.10 container is run kubectl pod.
> I have changed the following things in nifi.properties
> # cluster node properties (only configure for cluster nodes) #
> nifi.cluster.is.node=true
> nifi.cluster.node.address=XXXXXXXXXXXXXXXX
> nifi.cluster.node.protocol.port=8082
> nifi.cluster.node.protocol.max.threads=50
> nifi.cluster.node.event.history.size=25
> nifi.cluster.node.connection.timeout=5 sec
> nifi.cluster.node.read.timeout=5 sec
> nifi.cluster.node.max.concurrent.requests=100
> nifi.cluster.firewall.file=
> nifi.cluster.flow.election.max.wait.time=1 min
> nifi.cluster.flow.election.max.candidates=
> # cluster load balancing properties #
> nifi.cluster.load.balance.host=
> nifi.cluster.load.balance.port=6342
> nifi.cluster.load.balance.connections.per.node=1
> nifi.cluster.load.balance.max.thread.count=8
> nifi.cluster.load.balance.comms.timeout=30 sec
> # zookeeper properties, used for cluster management #
> nifi.zookeeper.connect.string=xxxx:2181,xxxx:2181,xxxx:2181
> nifi.zookeeper.connect.timeout=10 secs
> nifi.zookeeper.session.timeout=10 secs
> nifi.zookeeper.root.node=/nifi
> I am not able to connect zookeeper getting a connection error
> 2022-09-23 10:13:23,665 ERROR [main-EventThread] o.a.c.f.imps.CuratorFrameworkImpl Background operation retry gave up
> org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
>         at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:885)
>         at org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:677)
>         at org.apache.curator.framework.imps.WatcherRemovalFacade.processBackgroundOperation(WatcherRemovalFacade.java:152)
>         at org.apache.curator.framework.imps.GetConfigBuilderImpl$2.processResult(GetConfigBuilderImpl.java:222)
>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:601)
>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510)
> 2022-09-23 10:13:24,331 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: RECONNECTED
> 2022-09-23 10:13:24,331 INFO [Curator-ConnectionStateManager-0] o.a.n.c.l.e.CuratorLeaderElectionManager org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener at 30dbc287 Connection State changed to RECONNECTED
> 2022-09-23 10:13:24,431 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: SUSPENDED
> 2022-09-23 10:13:24,431 INFO [Curator-ConnectionStateManager-0] o.a.n.c.l.e.CuratorLeaderElectionManager org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener at 30dbc287 Connection State changed to SUSPENDED
> Connection State continues changing reconnecting and suspending
> How can I set up a NiFi cluster for using an external zookeeper connection?
> Did any one is facing simiar issues with this combination?
> Can you please assist



--
This message was sent by Atlassian JIRA
(v6.4.1#64016)