[Fiware-tech-help] Fiware Cygnus does not store data in Ckan

[Pierre Josselin]

Hello !

I asked this question on stackoverflow.com to maybe help people having same
issue :
https://stackoverflow.com/questions/46096676/fiware-cygnus-does-not-store-data-in-ckan

I come back to you in this great Fiware's adventure because i have a little
issue. Indeed data from the context broker are not stored in ckan
correctly. A Ckan organization called "def_serv", a ckan dataset called
"def_serv" too, and a ressource called "stade_philippe_roth_station_meteo"
are created, but no any data are stored. However, data is perfectly stored
in mysql. I check the 37 tables content of the postgresql database and not
found any of my data. I taked care with my token, host, port etc..

I notice the URL created is "http://none", surely not normal.

*Ckan Interface*




*Configuration file `agent_default.conf`*

    cygnusagent.sources = http-source
    cygnusagent.sinks = mysql-sink ckan-sink
    cygnusagent.channels = mysql-channel ckan-channel

    cygnusagent.sources.http-source.channels = mysql-channel ckan-channel
    cygnusagent.sources.http-source.type =
org.apache.flume.source.http.HTTPSource
    cygnusagent.sources.http-source.port = 5050
    cygnusagent.sources.http-source.handler =
com.telefonica.iot.cygnus.handlers.OrionRestHandler
    cygnusagent.sources.http-source.handler.events_ttl = 10
    cygnusagent.sources.http-source.interceptors = ts gi
    cygnusagent.sources.http-source.interceptors.ts.type = timestamp
    cygnusagent.sources.http-source.interceptors.gi.type =
com.telefonica.iot.cygnus.interceptors.GroupingInterceptor$Builder

cygnusagent.sources.http-source.interceptors.gi.grouping_rules_conf_file =
/usr/cygnus/conf/grouping_rules.conf

    cygnusagent.sinks.mysql-sink.channel = mysql-channel
    cygnusagent.sinks.mysql-sink.type =
com.telefonica.iot.cygnus.sinks.OrionMySQLSink
    cygnusagent.sinks.mysql-sink.enable_grouping = false
    cygnusagent.sinks.mysql-sink.enable_lowercase = false
    cygnusagent.sinks.mysql-sink.data_model = dm-by-entity
    cygnusagent.sinks.mysql-sink.mysql_host = localhost
    cygnusagent.sinks.mysql-sink.mysql_port = 3306
    cygnusagent.sinks.mysql-sink.mysql_username = root
    cygnusagent.sinks.mysql-sink.mysql_password = pass
    cygnusagent.sinks.mysql-sink.attr_persistence = row
    cygnusagent.sinks.mysql-sink.table_type = dm-by-entity
    cygnusagent.sinks.mysql-sink.batch_size = 1
    cygnusagent.sinks.mysql-sink.batch_timeout = 30
    cygnusagent.sinks.mysql-sink.batch_ttl = 10

    cygnusagent.sinks.ckan-sink.channel = ckan-channel
    cygnusagent.sinks.ckan-sink.type =
com.telefonica.iot.cygnus.sinks.OrionCKANSink
    cygnusagent.sinks.ckan-sink.enable_grouping = false
    cygnusagent.sinks.ckan-sink.enable_lowercase = false
    cygnusagent.sinks.ckan-sink.data_model = dm-by-entity
    cygnusagent.sinks.ckan-sink.api_key = avalidtoken
    cygnusagent.sinks.ckan-sink.ckan_host = 104.154.59.218
    cygnusagent.sinks.ckan-sink.ckan_port = 80
    cygnusagent.sinks.ckan-sink.orion_url = localhost:1026
    cygnusagent.sinks.ckan-sink.attr_persistence = row
    cygnusagent.sinks.ckan-sink.ssl = false
    cygnusagent.sinks.ckan-sink.batch_size = 1
    cygnusagent.sinks.ckan-sink.batch_timeout = 30
    cygnusagent.sinks.ckan-sink.batch_ttl = 10

    cygnusagent.channels.mysql-channel.type = memory
    cygnusagent.channels.mysql-channel.capacity = 1000
    cygnusagent.channels.mysql-channel.transactionCapacity = 100

    cygnusagent.channels.ckan-channel.type = memory
    cygnusagent.channels.ckan-channel.capacity = 1000
    cygnusagent.channels.ckan-channel.transactionCapacity = 100

*Log file `cygnus.log` (too long for stackoverflow)*

https://pastebin.com/wW8EzCgQ

Thank you !
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fiware.org/private/fiware-tech-help/attachments/20170907/80daad90/attachment.html>