[Fiware-lab-help] RV: Request of information on Big Data Analysis GE's module in charge of receiving context data from Orion

[Miguel Carrillo]

que prueben con otro navegador u otro pc. En algunos equipos falla

El 12/12/2013 17:32, FRANCISCO ROMERO BUENO escribió:
Me comenta un tipo de FINESCE que el link que hay en el catálogo para dejar feedback no funciona...

Saludos,
Paco

De: Massimiliano Nigrelli [mailto:massimiliano.nigrelli at eng.it]
Enviado el: jueves, 12 de diciembre de 2013 17:24
Para: FRANCISCO ROMERO BUENO
CC: Pasquale Andriani; Luigi Briguglio (Luigi.Briguglio at eng.it<mailto:Luigi.Briguglio at eng.it>)
Asunto: Re: Request of information on Big Data Analysis GE's module in charge of receiving context data from Orion

Just a note.

As suggested by my colleagues, 10 mins ago I tried to submit a tck via fiware catalogue's "provide feedback" link...........it was not working.

I will try later, in order to have an official tracking of my requests + your answers, if you don't mind.

Kind regards,

Massimiliano


==============================================================



Massimiliano Nigrelli - R&D Lab



Engineering Ingegneria Informatica S.p.A.



Viale Regione Siciliana 7275 -  90146 Palermo (Italy)



Phone: +39-091.75.11.735



==============================================================
Il 12/12/2013 17.18, FRANCISCO ROMERO BUENO ha scritto:
Hi Massimiliano,

Regarding your questions:


*         Yes, the ngsi2cosmos module is already available. You can download it from GitHub and you can learn about how to install and configure it, respectively, from here:

o   https://github.com/telefonicaid/fiware-livedemoapp/tree/master/package/ngsi2cosmos

o   https://github.com/telefonicaid/fiware-livedemoapp#ngsi2cosmos

*         Injection and ingestion and natively provided as a RESTful API by Hadoop. This is called WebHDFS and you can find further information here:

o   http://forge.fi-ware.eu/plugins/mediawiki/wiki/fiware/index.php/BigData_Analysis_Open_RESTful_API_Specification_%28PRELIMINARY%29#WebHDFS

*         Regarding the MapReduce jobs, we are going to include Apache Oozie in the following releases. This is a tool for remotely running MR jobs, designing workflows of jobs... If this is a requirement strictly necessary for you, I could try to install Oozie by myself in the current global instance of the GE.

o   http://oozie.apache.org/

Any question you may have, do not hesitate to talk with me.

Regards,
Francisco

De: Massimiliano Nigrelli [mailto:massimiliano.nigrelli at eng.it]
Enviado el: jueves, 12 de diciembre de 2013 16:23
Para: FRANCISCO ROMERO BUENO
CC: Pasquale Andriani; Luigi Briguglio (Luigi.Briguglio at eng.it<mailto:Luigi.Briguglio at eng.it>)
Asunto: Request of information on Big Data Analysis GE's module in charge of receiving context data from Orion

Dear Francisco Romero Bueno,
I am Massimiliano Nigrelli from ENG. I have recently been accounted on FINESCE WP4 (a FI-PPP project) where (among all) we should come to the identification of the DSEs and GEs to be used for the development, test and evaluation of an operational near- real-time electricity marketplace system.

In our scenario, roughly, metering data coming from smart meters (installed at trial site premises) should be published to the Context Broker GE (Orion) via the Gateway Device Mgmt GE (the Ericsson's one).
Then, context data "produced" by Orion should be injected/ingested in the Big Data Analysis (BDA) GE, the one you supervise and manage, in order to perform Map/Reduce jobs and thus providing an output for future decisions/actions related, for example, to adjust electricity price plans and to balance load at customers' location.

I have spent the last days reading about BDA GE in the FI-WARE catalogue and then I have studied the documentation available in the FI-WARE wiki (BigData Analysis Open RESTful API Specification (PRELIMINARY)).

Sorry to be so direct but I have the following two questions:
1) In the catalogue, I read "There is also a module in charge of receiving context data from Orion (Context Broker GE implementation) and storing it in HDFS.".......is this module available at this stage? If not, when would you plan to make it available?
2) Is the BDA GE going to expose some RESTful/Java APIs to programmatically perform injection/ingestion and "Map/Reduce" of those data coming from Orion?
If not, is it going to work only in batch mode like it is now?

Please accept my apologies for my questions but we are ready to start a development phase and we should need to have a better idea about how BDA will work, if it is tailored on the interaction with Orion and which modes (batch vs. stream) it will support.

Thank you in advance for your time.

Waiting for your answers.

Kind regards,

Massimiliano

--

==============================================================



Massimiliano Nigrelli - R&D Lab



Engineering Ingegneria Informatica S.p.A.



Viale Regione Siciliana 7275 -  90146 Palermo (Italy)



Phone: +39-091.75.11.735



==============================================================

________________________________

Este mensaje se dirige exclusivamente a su destinatario. Puede consultar nuestra política de envío y recepción de correo electrónico en el enlace situado más abajo.
This message is intended exclusively for its addressee. We only send and receive email on the basis of the terms set out at:
http://www.tid.es/ES/PAGINAS/disclaimer.aspx


________________________________

Este mensaje se dirige exclusivamente a su destinatario. Puede consultar nuestra política de envío y recepción de correo electrónico en el enlace situado más abajo.
This message is intended exclusively for its addressee. We only send and receive email on the basis of the terms set out at:
http://www.tid.es/ES/PAGINAS/disclaimer.aspx



_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help at lists.fi-ware.eu<mailto:Fiware-lab-help at lists.fi-ware.eu>
https://lists.fi-ware.eu/listinfo/fiware-lab-help



--
----------------------------------------------------------------------
     _/          _/_/                     Miguel Carrillo Pacheco
    _/   _/     _/  _/   Telefónica       Distrito Telefónica
   _/ _/_/_/   _/   _/   Investigación y  Edifico Oeste 1, Planta 9
  _/   _/     _/  _/     Desarrollo       Ronda de la Comunicación S/N
 _/          _/_/                         28050 Madrid (Spain)
                                          Tel:  (+34) 91 483 26 77

                                          e-mail: mcp at tid.es<mailto:mcp at tid.es>

Follow FI-WARE on the net

        Website:  http://www.fi-ware.eu
        Facebook: http://www.facebook.com/pages/FI-WARE/251366491587242
        Twitter:  http://twitter.com/Fiware
        LinkedIn: http://www.linkedin.com/groups/FIWARE-4239932
----------------------------------------------------------------------

________________________________

Este mensaje se dirige exclusivamente a su destinatario. Puede consultar nuestra política de envío y recepción de correo electrónico en el enlace situado más abajo.
This message is intended exclusively for its addressee. We only send and receive email on the basis of the terms set out at:
http://www.tid.es/ES/PAGINAS/disclaimer.aspx
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fiware.org/private/fiware-lab-help/attachments/20131212/cc5a94f8/attachment.html>