Thanks Jose,
Now I am getting DB connection error. I Googled and did following steps. Please suggest.
1.
docker run --name=mysqlser -e MYSQL_ROOT_HOST=% -d mysql/mysql-server
And change root user’s password.
2.
docker run -d --name cygnus-mysql --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=mypassword -e CYGNUS_LOG_LEVEL='DEBUG' fiware/cygnus-ngsi
3.
Changed Agent file and keep only mysql-sink. Restarted Cygnus container.
cygnus-ngsi.sinks = mysql-sink
cygnus-ngsi.channels = mysql-channel
4.
mosquitto_pub -h <myIP> -u <MyEmail> -P <MyPassword> -t /swm-reader-service/reader-device-id/attrs -m '{"tn": "7777", "pn": "123456", "ri": "98765", "tdt":"Monday, May 7, 2018 4:31 PM"}'
MySQL Docker Container’s IP = 172.17.0.2
Cygnus Docker Container’s IP = 172.17.0.3
Error Logs:
Connecting to jdbc:mysql://172.17.0.2:3306/?user=root&password=XXXXXXXXXX
time=2018-05-09T11:58:37.212Z | lvl=ERROR | corr=4e308fde-5380-11e8-9a32-0242ac120004 | trans=b33b7c8c-90c1-493a-835c-ef6c44a451b1 | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=processNewBatches | msg=com.telefonica.iot.cygnus.sinks.NGSISink[569] : CygnusPersistenceError (SQLException). Connection error (Could not create connection to database server.). Stack trace: [com.telefonica.iot.cygnus.backends.mysql.MySQLBackendImpl$MySQLDriver.getConnection(MySQLBackendImpl.java:416), com.telefonica.iot.cygnus.backends.mysql.MySQLBackendImpl.createDatabase(MySQLBackendImpl.java:86), com.telefonica.iot.cygnus.sinks.NGSIMySQLSink.persistAggregation(NGSIMySQLSink.java:552), com.telefonica.iot.cygnus.sinks.NGSIMySQLSink.persistBatch(NGSIMySQLSink.java:200), com.telefonica.iot.cygnus.sinks.NGSISink.processNewBatches(NGSISink.java:558), com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:370), org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68), org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147), java.lang.Thread.run(Thread.java:748)]
Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996
============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================
From: Jose Ignacio Carretero <joseignacio.carretero at fiware.org>
Sent: Wednesday, May 9, 2018 2:51 PM
To: Krishan Babbar <KB00449283 at TechMahindra.com>
Cc: Yugal Kishor Mullick <YM00106030 at TechMahindra.com>; fiware-tech-help at lists.fiware.org; Fernando López Aguilar <fernando.lopez at fiware.org>
Subject: RE: Unable to run Cygnus with MySQL agent
Hi,
I mean in the subscription you provided a couple of days ago, find the "attrsFormat" in the json payload. Instead of writing "normalized", please, change it for "legacy".
Regards,
José Ignacio
Enviado desde BlueMail<http://www.bluemail.me/r?b=12874>
En 9 may. 2018, en 11:10, Krishan Babbar <kb00449283 at techmahindra.com<mailto:kb00449283 at techmahindra.com>> escribió:
Thanks Jose,
Could you please provide an example or reference URL showing what to change and how to use it ?
Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996
============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================
From: José Ignacio Carretero <joseignacio.carretero at fiware.org<mailto:joseignacio.carretero at fiware.org>>
Sent: Wednesday, May 9, 2018 4:49 AM
To: Yugal Kishor Mullick <YM00106030 at TechMahindra.com<mailto:YM00106030 at TechMahindra.com>>; Krishan Babbar <KB00449283 at TechMahindra.com<mailto:KB00449283 at TechMahindra.com>>; fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>; Fernando López Aguilar <fernando.lopez at fiware.org<mailto:fernando.lopez at fiware.org>>
Subject: Re: Unable to run Cygnus with MySQL agent
Hi,
After doing some research, I think that the problem may come because of the Cygnus subscription. As Cygnus just works with NGSIv1, attrsFormat should be "legacy" instead of "normalized".
Regards,
José Ignacio
El 08/05/18 a las 15:12, Yugal Kishor Mullick escribió:
Dear Fiware Team,
Tried to reach you for urgent help…no luck.
Look forward for you earliest support on this matter below..pls. This is critical for business.
Thanks for extending your support so far.
----------------------------------
Regards,
Yugal | Smart City- Global
Mobile: (+91)-77.98.78.4888
From: Yugal Kishor Mullick
Sent: Tuesday, May 8, 2018 1:08 PM
To: Krishan Babbar <KB00449283 at TechMahindra.com><mailto:KB00449283 at TechMahindra.com>; José Ignacio Carretero <joseignacio.carretero at fiware.org><mailto:joseignacio.carretero at fiware.org>; fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>; 'Fernando López Aguilar' <fernando.lopez at fiware.org><mailto:fernando.lopez at fiware.org>
Subject: RE: Unable to run Cygnus with MySQL agent
++ Fernando
----------------------------------
Regards,
Yugal | Smart City- Global
Mobile: (+91)-77.98.78.4888
From: Krishan Babbar
Sent: Monday, May 7, 2018 4:57 PM
To: José Ignacio Carretero <joseignacio.carretero at fiware.org<mailto:joseignacio.carretero at fiware.org>>; fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>
Cc: Yugal Kishor Mullick <YM00106030 at TechMahindra.com<mailto:YM00106030 at TechMahindra.com>>
Subject: RE: Unable to run Cygnus with MySQL agent
Hi Jose,
I created new data again as given below, and still getting the same error. Details are given below.
Entity
Headers:
fiware-service: smartcitytechm
fiware-servicepath: /
{
"id": "reader-jp-id",
"type": "Reader",
"parcelNo": {
"type": "Text",
"value": "0101102195a3",
"metadata": {}
},
"readerId": {
"type": "Text",
"value": "566",
"metadata": {}
},
"tagNo": {
"type": "Text",
"value": "69219163",
"metadata": {}
},
"trnxDateTiem": {
"type": "Text",
"value": "Monday, May 7, 2018 4:08 PM",
"metadata": {}
}
}
Service
{
"_id": "5af02c19d047df057cfa063f",
"subservice": "/",
"service": "smartcitytechm",
"apikey": "swm-reader-service",
"resource": "/iot/json",
"attributes": [],
"lazy": [],
"commands": [],
"entity_type": "Reader",
"internal_attributes": [],
"static_attributes": []
}
Device
{
"count": 1,
"devices": [
{
"device_id": "reader-device-id",
"service": "smartcitytechm",
"service_path": "/",
"entity_name": "reader-jp-id",
"entity_type": "Reader",
"transport": "HTTP",
"attributes": [
{
"object_id": "tn",
"name": "tagNo",
"type": "Text"
},
{
"object_id": "pn",
"name": "parcelNo",
"type": "Text"
},
{
"object_id": "ri",
"name": "readerId",
"type": "Text"
},
{
"object_id": "tdt",
"name": "trnxDateTiem",
"type": "Text"
}
],
"lazy": [],
"commands": [],
"static_attributes": [],
"protocol": "HTTP"
}
]
}
Subscription
[
{
"id": "5af02f9f7ef878ae8ebac1dd",
"description": "Update reader data",
"expires": "2020-04-05T14:00:00.00Z",
"status": "active",
"subject": {
"entities": [
{
"idPattern": ".*",
"type": "Reader"
}
],
"condition": {
"attrs": [
"tagNo",
"parcelNo",
"readerId",
"trnxDateTiem"
]
}
},
"notification": {
"timesSent": 1,
"lastNotification": "2018-05-07T10:51:11.00Z",
"attrs": [
"tagNo",
"parcelNo",
"readerId",
"trnxDateTiem"
],
"attrsFormat": "normalized",
"http": {
"url": "http://<MyIP>:5050/notify<http://%3cMyIP%3e:5050/notify>"
},
"lastSuccess": "2018-05-07T10:51:11.00Z"
},
"throttling": 5
}
]
Update Entity (Through MQTT). Now I am using “iotagent-json”. Earlier I was using “iotagent-UL” and updating entity using Send Measurement (on HTTP) and was getting same error.
mosquitto_pub -h <myIP> -u <MyEmail> -P <MyPassword> -t /swm-reader-service/reader-device-id/attrs -m '{"tn": "7777", "pn": "123456", "ri": "98765", "tdt":"Monday, May 7, 2018 4:31 PM"}'
Entity after update
{
"id": "reader-jp-id",
"type": "Reader",
"TimeInstant": {
"type": "ISO8601",
"value": "2018-05-07T11:07:43.00Z",
"metadata": {}
},
"parcelNo": {
"type": "Text",
"value": "123456",
"metadata": {
"TimeInstant": {
"type": "ISO8601",
"value": "2018-05-07T11:07:43.010Z"
}
}
},
"readerId": {
"type": "Text",
"value": "98765",
"metadata": {
"TimeInstant": {
"type": "ISO8601",
"value": "2018-05-07T11:07:43.010Z"
}
}
},
"tagNo": {
"type": "Text",
"value": "7777",
"metadata": {
"TimeInstant": {
"type": "ISO8601",
"value": "2018-05-07T11:07:43.010Z"
}
}
},
"trnxDateTiem": {
"type": "Text",
"value": "Monday, May 7, 2018 4:31 PM",
"metadata": {
"TimeInstant": {
"type": "ISO8601",
"value": "2018-05-07T11:07:43.010Z"
}
}
}
}
Cygnus Error Logs
time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[294] : [NGSIRestHandler] Starting internal transaction (5a089c42-032b-46d2-869e-dc944a4167c0)
time=2018-05-07T11:07:43.108Z | lvl=INFO | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[312] : [NGSIRestHandler] Received data ({"subscriptionId":"5af02f9f7ef878ae8ebac1dd","data":[{"id":"reader-jp-id","type":"Reader","tagNo":{"type":"Text","value":"7777","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}}},"parcelNo":{"type":"Text","value":"123456","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}}},"readerId":{"type":"Text","value":"98765","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}}},"trnxDateTiem":{"type":"Text","value":"Monday, May 7, 2018 4:31 PM","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-07T11:07:43.010Z"}}}}]})
time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses
time=2018-05-07T11:07:43.111Z | lvl=WARN | corr=dd32be00-51e6-11e8-9d77-0242ac120004 | trans=5a089c42-032b-46d2-869e-dc944a4167c0 | srv=smartcitytechm | subsrv=/ | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet[186] : Received bad request from client.
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335)
at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
My Docker Containers:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
65b96b1bc07f fiware/cygnus-ngsi "/cygnus-entrypoint.…" 3 days ago Up 3 days 0.0.0.0:5050->5050/tcp, 0.0.0.0:8081->8081/tcp cygnus-mysql1
c7d1d0ed4742 mysql/mysql-server "/entrypoint.sh mysq…" 3 days ago Up 3 days (healthy) 3306/tcp, 33060/tcp mysqlser
971ada7b5eb0 fiware/orion "/usr/bin/contextBro…" 10 days ago Up 10 days 0.0.0.0:1026->1026/tcp ubuntu_orion_1
7104c27ce1e1 mongo:3.2 "docker-entrypoint.s…" 10 days ago Up 10 days 0.0.0.0:27017->27017/tcp ubuntu_mongo_1
2e6baf2fc953 ansi/mosquitto "/usr/local/sbin/mos…" 10 days ago Up 10 days 0.0.0.0:1883->1883/tcp ubuntu_mosquitto_1
Thanks again for all your help.
Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996
============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================
From: José Ignacio Carretero <joseignacio.carretero at fiware.org<mailto:joseignacio.carretero at fiware.org>>
Sent: Friday, May 4, 2018 7:55 PM
To: Krishan Babbar <KB00449283 at TechMahindra.com<mailto:KB00449283 at TechMahindra.com>>; fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>
Cc: Yugal Kishor Mullick <YM00106030 at TechMahindra.com<mailto:YM00106030 at TechMahindra.com>>
Subject: Re: Unable to run Cygnus with MySQL agent
I can't reproduce what you are doing --- How did you get there? What are you sending to CB and the Cygnus register?
Best regards,
José Ignacio
El 04/05/18 a las 15:13, Krishan Babbar escribió:
It seems some issue in configuration or so.
Similar issue is mentioned at https://ask.fiware.org/question/825/error-at-cygnus-when-receives-a-notification-from-orion-context-broker-fiware-servicepath-header-value-does-not-match-the-number-of-notified-context/
But still no solution.
Regards,
Krishan
From: José Ignacio Carretero <joseignacio.carretero at fiware.org><mailto:joseignacio.carretero at fiware.org>
Sent: Friday, May 4, 2018 6:18 PM
To: Krishan Babbar <KB00449283 at TechMahindra.com><mailto:KB00449283 at TechMahindra.com>; fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>
Cc: Yugal Kishor Mullick <YM00106030 at TechMahindra.com><mailto:YM00106030 at TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent
I removed people @telefonica.com who are no longer in the project since about 1 year ago. But I guess the key is here:
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
El 04/05/18 a las 14:33, Krishan Babbar escribió:
Thanks Jose,
And sorry for bothering you again.
I created subscription using below JSON. Data reached to Cygnus but I am getting errors in logs (given below). What am I doing wrong?
{
"description": "Update controller ph1Vol",
"subject": {
"entities": [
{
"idPattern": ".*",
"type": "Controller"
}
],
"condition": {
"attrs": [
"ph1Vol"
]
}
},
"notification": {
"mqtt": {
"url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify>
},
"http": {
"url": "http://IPAddress:5050/notify"<http://IPAddress:5050/notify>
},
"attrs": [
"id",
"type",
"name",
"ph1Vol",
"current"
]
},
"expires": "2020-04-05T14:00:00.00Z",
"throttling": 5
}
Logs
time=2018-05-04T09:23:15.026Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getLogLevel | msg=com.telefonica.iot.cygnus.management.LogHandlers[1029] : Cygnus logging level successfully obtained
time=2018-05-04T12:13:00.017Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[294] : [NGSIRestHandler] Starting internal transaction (0d2b65a1-0be4-4371-8d83-4426d281b83d)
time=2018-05-04T12:13:00.024Z | lvl=INFO | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[312] : [NGSIRestHandler] Received data ({"subscriptionId":"5aec4e4b7ef878ae8ebac1d9","data":[{"id":"ctrl_chandigrah","type":"Controller","name":{"type":"Text","value":"Noida-SEZ Controller 2","metadata":{}},"ph1Vol":{"type":"Text","value":"228","metadata":{"TimeInstant":{"type":"ISO8601","value":"2018-05-04T12:02:46.398Z"}}}}]})
time=2018-05-04T12:13:00.122Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=getEvents | msg=com.telefonica.iot.cygnus.handlers.NGSIRestHandler[332] : [NGSIRestHandler] Bad HTTP notification ('fiware-servicepath' header value does not match the number of notified context responses
time=2018-05-04T12:13:00.123Z | lvl=WARN | corr=7c9c0654-4f94-11e8-ab43-0242ac120004 | trans=0d2b65a1-0be4-4371-8d83-4426d281b83d | srv=smartcitytechm | subsrv=/smartcitytechmchandigarh | comp=cygnus-ngsi | op=doPost | msg=org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet[186] : Received bad request from client.
org.apache.flume.source.http.HTTPBadRequestException: 'fiware-servicepath' header value does not match the number of notified context responses
at com.telefonica.iot.cygnus.handlers.NGSIRestHandler.getEvents(NGSIRestHandler.java:335)
at org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:184)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Regards,
Krishan
From: José Ignacio Carretero <joseignacio.carretero at fiware.org><mailto:joseignacio.carretero at fiware.org>
Sent: Friday, May 4, 2018 3:16 PM
To: Krishan Babbar <KB00449283 at TechMahindra.com><mailto:KB00449283 at TechMahindra.com>; fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>; herman.junge at telefonica.com<mailto:herman.junge at telefonica.com>; ivan.ariasleon at telefonica.com<mailto:ivan.ariasleon at telefonica.com>; german.torodelvalle at telefonica.com<mailto:german.torodelvalle at telefonica.com>; francisco.romerobueno at telefonica.com<mailto:francisco.romerobueno at telefonica.com>; fermin.galanmarquez at telefonica.com<mailto:fermin.galanmarquez at telefonica.com>; pablo.coellovillalba at telefonica.com<mailto:pablo.coellovillalba at telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030 at TechMahindra.com><mailto:YM00106030 at TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent
Databases will be created as data comes. Please, use your Orion CB to push some data into Cygnus (through subscriptions).
Regards,
José Ignacio
El 04/05/18 a las 11:40, Krishan Babbar escribió:
Thanks Jose,
I ran following commands
1.
docker run --name=mysqlser -d mysql/mysql-server
2.
docker run -d --name cygnus-mysql1 --link mysqlser -p 8081:8081 -p 5050:5050 -e CYGNUS_MYSQL_HOST=172.17.0.2 -e CYGNUS_MYSQL_PORT=3306 -e CYGNUS_MYSQL_USER=root -e CYGNUS_MYSQL_PASS=<Root_Password> fiware/cygnus-ngsi
I logged into MySQL Container but did not see any DB.
I could see only following DBs.
docker exec -it mysqlser mysql -u root -p
mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| performance_schema |
| sys |
+--------------------+
4 rows in set (0.00 sec)
What would be the expected behavior?
How to cross check if MySQL Sink is working fine?
Regards,
Krishan
From: José Ignacio Carretero <joseignacio.carretero at fiware.org><mailto:joseignacio.carretero at fiware.org>
Sent: Friday, May 4, 2018 2:19 PM
To: Krishan Babbar <KB00449283 at TechMahindra.com><mailto:KB00449283 at TechMahindra.com>; fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>; herman.junge at telefonica.com<mailto:herman.junge at telefonica.com>; ivan.ariasleon at telefonica.com<mailto:ivan.ariasleon at telefonica.com>; german.torodelvalle at telefonica.com<mailto:german.torodelvalle at telefonica.com>; francisco.romerobueno at telefonica.com<mailto:francisco.romerobueno at telefonica.com>; fermin.galanmarquez at telefonica.com<mailto:fermin.galanmarquez at telefonica.com>; pablo.coellovillalba at telefonica.com<mailto:pablo.coellovillalba at telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030 at TechMahindra.com><mailto:YM00106030 at TechMahindra.com>
Subject: Re: Unable to run Cygnus with MySQL agent
I've answered the Stackoverflow question.
Regards,
José Ignacio
El 03/05/18 a las 15:37, Krishan Babbar escribió:
+ pablo.coellovillalba at telefonica.com<mailto:pablo.coellovillalba at telefonica.com>
+ fermin.galanmarquez at telefonica.com<mailto:fermin.galanmarquez at telefonica.com>
+francisco.romerobueno at telefonica.com<mailto:francisco.romerobueno at telefonica.com>
+ german.torodelvalle at telefonica.com<mailto:german.torodelvalle at telefonica.com>
+ ivan.ariasleon at telefonica.com<mailto:ivan.ariasleon at telefonica.com>
Looking forward for your guidance.
Asked the same question on https://ask.fiware.org/question/989/unable-to-run-cygnus-with-mysql-agent/ and https://stackoverflow.com/questions/50102920/unable-to-run-cygnus-with-mysql-agent also.
Regards,
Krishan
From: Krishan Babbar
Sent: Monday, April 30, 2018 7:59 PM
To: fiware-tech-help at lists.fiware.org<mailto:fiware-tech-help at lists.fiware.org>; José Ignacio Carretero <joseignacio.carretero at fiware.org><mailto:joseignacio.carretero at fiware.org>; herman.junge at telefonica.com<mailto:herman.junge at telefonica.com>
Cc: Yugal Kishor Mullick <YM00106030 at TechMahindra.com><mailto:YM00106030 at TechMahindra.com>
Subject: Unable to run Cygnus with MySQL agent
Hi All,
I am trying to setup and understand Cygnus. But I am facing issue during installation.
I followed below given steps.
1. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common)
2. Executed version command (curl http://172.17.0.2:8081/v1/version) which gave following response
a. {"success":"true","version":"1.8.0_SNAPSHOT.39b2aa4789c61fa92fe6edc905410f1ddeb33490"}
3. Login into Cygnus container using command docker exec -it <ContainerId> /bin/bash
4. Created new file named “agent_mysql.conf” in “/opt/apache-flume/conf/” folder. Please see attached file for configuration details.
5. Changed "cygnus-entrypoint.sh" file in / (root) folder and added following command by removing existing one.
a. ${FLUME_HOME}/bin/cygnus-flume-ng agent --conf ${CYGNUS_CONF_PATH} -f ${CYGNUS_CONF_PATH}/agent_mysql.conf -n cygnus-ngsi -p ${CYGNUS_API_PORT} -Dflume.root.logger=${CYGNUS_LOG_LEVEL},${CYGNUS_LOG_APPENDER} -Dfile.encoding=UTF-8
6. Exited Docker container and came back to Ubuntu.
7. Stop and restart Docker container.
8. And I am getting following errors in logs
Please check and let me know what am I doing wrong? Appreciate your help.
n$AgentConfiguration[1016] : Processing:mysql-sink
time=2018-04-30T14:24:00.807Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=validateConfiguration | msg=org.apache.flume.conf.FlumeConfiguration[140] : Post-validation flume configuration contains configuration for agents: [cygnus-ngsi]
time=2018-04-30T14:24:00.808Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[150] : Creating channels
time=2018-04-30T14:24:00.816Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.channel.DefaultChannelFactory[40] : Creating instance of channel mysql-channel type memory
time=2018-04-30T14:24:00.825Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadChannels | msg=org.apache.flume.node.AbstractConfigurationProvider[205] : Created channel mysql-channel
time=2018-04-30T14:24:00.832Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.source.DefaultSourceFactory[39] : Creating instance of source http-source, type org.apache.flume.source.http.HTTPSource
time=2018-04-30T14:24:00.836Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=configure | msg=org.apache.flume.source.http.HTTPSource[113] : Error while configuring HTTPSource. Exception follows.
java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
time=2018-04-30T14:24:00.840Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=loadSources | msg=org.apache.flume.node.AbstractConfigurationProvider[366] : Source http-source has been removed due to an error during configuration
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:114)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:331)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.handlers.NGSIRestHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.http.HTTPSource.configure(HTTPSource.java:102)
... 11 more
time=2018-04-30T14:24:00.841Z | lvl=INFO | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=create | msg=org.apache.flume.sink.DefaultSinkFactory[40] : Creating instance of sink: mysql-sink, type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
time=2018-04-30T14:24:00.842Z | lvl=ERROR | corr=N/A | trans=N/A | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=run | msg=org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable[142] : Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load sink type: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink, class: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:69)
at org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:415)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:103)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.telefonica.iot.cygnus.sinks.NGSIMySQLSink
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.sink.DefaultSinkFactory.getClass(DefaultSinkFactory.java:67)
... 11 more
Thanks & Regards,
Krishan Babbar
Technical Architect
IES Internet of Things | Tech Mahindra
Rajiv Gandhi Chandigarh Technology Park, Plot No. 23, Phase 2, Kishangarh, Chandigarh 160101, INDIA
• Office: +91 172 666 8400 Ext. 8352 | Mobile: +91 946 303 0996
============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
===========================================================================================================================
============================================================================================================================
Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.
============================================================================================================================
--
−−−
José Ignacio Carretero
FIWARE Cloud and Platform Expert
FIWARE Foundation
[FIWARE Foundation]
Franklinstrasse 13A
10587 Berlin
email: joseignacio.carretero at fiware.org<mailto:joseignacio.carretero at fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero
--
−−−
José Ignacio Carretero
FIWARE Cloud and Platform Expert
FIWARE Foundation
[FIWARE Foundation]
Franklinstrasse 13A
10587 Berlin
email: joseignacio.carretero at fiware.org<mailto:joseignacio.carretero at fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero
--
−−−
José Ignacio Carretero
FIWARE Cloud and Platform Expert
FIWARE Foundation
[FIWARE Foundation]
Franklinstrasse 13A
10587 Berlin
email: joseignacio.carretero at fiware.org<mailto:joseignacio.carretero at fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero
--
−−−
José Ignacio Carretero
FIWARE Cloud and Platform Expert
FIWARE Foundation
[FIWARE Foundation]
Franklinstrasse 13A
10587 Berlin
email: joseignacio.carretero at fiware.org<mailto:joseignacio.carretero at fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero
--
−−−
José Ignacio Carretero
FIWARE Cloud and Platform Expert
FIWARE Foundation
[FIWARE Foundation]
Franklinstrasse 13A
10587 Berlin
email: joseignacio.carretero at fiware.org<mailto:joseignacio.carretero at fiware.org>
www: http://fiware.org
twitter: @jicarreterogu @FIWARE
skype: jicarretero
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20180509/8d0a5e3b/attachment-0001.html>
You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy Cookies policy