[Backlogmanager] [FIWARE-JIRA] (HELP-14200) [fiware-stackoverflow] ECONNRESET when opening a large number of connection in small time period

[Fernando Lopez (JIRA)]

     [ https://jira.fiware.org/browse/HELP-14200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fernando Lopez updated HELP-14200:
----------------------------------
    Description: 
Created question in FIWARE Q/A platform on 27-05-2018 at 16:05
{color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/50553119/econnreset-when-opening-a-large-number-of-connection-in-small-time-period


+Question:+
ECONNRESET when opening a large number of connection in small time period

+Description:+
I have situation where i want to create large number of entities on orion. I am using docker version of orion and mongo with this docker-compose.

version: "3"
services:
  mongo:
    image: mongo:3.4
    volumes:
      - /data/docker-mongo/db:/data/db
      - /data/docker-mongo/log/mongodb.log:/var/log/mongodb/mongod.log
    command: --nojournal
  orion:
    image: fiware/orion
    volumes:
      - /data/docker-mongo/log/contextBroker.log:/tmp/contextBroker.log
    links:
      - mongo
    ports:
      - "1026:1026"
    command: -dbhost mongo

Now problems happens when i want to upload 2000 entities ( opening new connection for each, i know it can be done different but for now this is request), i successfully create no more than 600 (or less never exact number) of them rest fail to create with error:

"error": {
            "errno": "ECONNRESET",
            "code": "ECONNRESET",
            "syscall": "read"
        },

So i assume this issue has something to do with maxConnections, reqPoolSize etc settings in Orion. But in docker i failed to locate Orion config file, i have no way of knowing when i type commands like contextBroker -maxConnections 123456 that setting is being accepted by Orion and docker container.

Also log of Orion is empty, and i cannot determined what is causing this issue when Orion is running on docker. 

So main questions: 
- Can Orion running on docker be used in same manner as Orion running on VM (are there some fallbacks)
- And how do i check this problem when Orion is running in docker, because i read a lot of docs/issues but no luck ( or i missed something).

If u have some advice/soultion it would really help.
Thanks


  was:

Created question in FIWARE Q/A platform on 27-05-2018 at 16:05
{color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/50553119/econnreset-when-opening-a-large-number-of-connection-in-small-time-period


+Question:+
ECONNRESET when opening a large number of connection in small time period

+Description:+
I have situation where i want to create large number of entities on orion. I am using docker version of orion and mongo with this docker-compose.

version: "3"
services:
  mongo:
    image: mongo:3.4
    volumes:
      - /data/docker-mongo/db:/data/db
      - /data/docker-mongo/log/mongodb.log:/var/log/mongodb/mongod.log
    command: --nojournal
  orion:
    image: fiware/orion
    volumes:
      - /data/docker-mongo/log/contextBroker.log:/tmp/contextBroker.log
    links:
      - mongo
    ports:
      - "1026:1026"
    command: -dbhost mongo

Now problems happens when i want to upload 2000 entities ( opening new connection for each, i know it can be done different but for now this is request), i successfully create no more than 600 (or less never exact number) of them rest fail to create with error:

"error": {
            "errno": "ECONNRESET",
            "code": "ECONNRESET",
            "syscall": "read"
        },

So i assume this issue has something to do with maxConnections, reqPoolSize etc settings in Orion. But in docker i failed to locate Orion config file, i have no way of knowing when i type commands like contextBroker -maxConnections 123456 that setting is being accepted by Orion and docker container.

Also log of Orion is empty, and i cannot determined what is causing this issue when Orion is running on docker. 

So main questions: 
- Can Orion running on docker be used in same manner as Orion running on VM (are there some fallbacks)
- And how do i check this problem when Orion is running in docker, because i read a lot of docs/issues but no luck ( or i missed something).

If u have some advice/soultion it would really help.
Thanks


     HD-Enabler: Orion

> [fiware-stackoverflow] ECONNRESET when opening a large number of connection in small time period
> ------------------------------------------------------------------------------------------------
>
>                 Key: HELP-14200
>                 URL: https://jira.fiware.org/browse/HELP-14200
>             Project: Help-Desk
>          Issue Type: Monitor
>          Components: FIWARE-TECH-HELP
>            Reporter: Backlog Manager
>            Assignee: Jose Manuel Cantera
>              Labels: fiware, fiware-orion
>
> Created question in FIWARE Q/A platform on 27-05-2018 at 16:05
> {color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/50553119/econnreset-when-opening-a-large-number-of-connection-in-small-time-period
> +Question:+
> ECONNRESET when opening a large number of connection in small time period
> +Description:+
> I have situation where i want to create large number of entities on orion. I am using docker version of orion and mongo with this docker-compose.
> version: "3"
> services:
>   mongo:
>     image: mongo:3.4
>     volumes:
>       - /data/docker-mongo/db:/data/db
>       - /data/docker-mongo/log/mongodb.log:/var/log/mongodb/mongod.log
>     command: --nojournal
>   orion:
>     image: fiware/orion
>     volumes:
>       - /data/docker-mongo/log/contextBroker.log:/tmp/contextBroker.log
>     links:
>       - mongo
>     ports:
>       - "1026:1026"
>     command: -dbhost mongo
> Now problems happens when i want to upload 2000 entities ( opening new connection for each, i know it can be done different but for now this is request), i successfully create no more than 600 (or less never exact number) of them rest fail to create with error:
> "error": {
>             "errno": "ECONNRESET",
>             "code": "ECONNRESET",
>             "syscall": "read"
>         },
> So i assume this issue has something to do with maxConnections, reqPoolSize etc settings in Orion. But in docker i failed to locate Orion config file, i have no way of knowing when i type commands like contextBroker -maxConnections 123456 that setting is being accepted by Orion and docker container.
> Also log of Orion is empty, and i cannot determined what is causing this issue when Orion is running on docker. 
> So main questions: 
> - Can Orion running on docker be used in same manner as Orion running on VM (are there some fallbacks)
> - And how do i check this problem when Orion is running in docker, because i read a lot of docs/issues but no luck ( or i missed something).
> If u have some advice/soultion it would really help.
> Thanks



--
This message was sent by Atlassian JIRA
(v6.4.1#64016)