[Fiware-data] Consolidated version of the Context/Data Management Chapter in the FI-WARE High-level Description

[Juanjo Hierro]

Dear Colleagues,

  You can find a first consolidated draft of the Context/Data Management Chapter in the FI-WARE High-Level Description Document.

  Some remarks:

 *   Overall, the description of GEs still require quite some work.   Without entering into the actual contents, the description of GEs provided by Siemens (multimedia analysis to gather multi-media metadata, preprocesing of metadata after/during gathering and Searching/Quering Access) are very good examples of the level of detail and style of description we should intend to achieve.   Going more into details for each of the GEs:
    *   Big Data Processing Enabler: We have to provide much more level of detail.   It would be rather relevant to describe what operations will be offered to programmers going beyond the simple map-reduce operations that existing products such as Hadoop currently offer.
    *   Regarding the Complex Event Processing Enabler, you should elaborate on the architecture of the implementation we are currently envisioning a little bit (concept of network of processing nodes).  You, of course, have to point out that this would be considered a potential implementation but not the only one that could be valid.   Besides, it would be worth providing a vision and description of operations (API) that the GE will offer to the programmer of how a given application will invoke those operations at runtime.
    *   Regarding the GEs whose description was provided by Siemens, once again they are in a very good shape.   However, we have to still work on some of them: a) we have to find out whether we need something like the "preprocesing of metadata after/during gathering" enabler of this same functionality can be achieved through the CEP generic enabler; b) we have to probably review the GE on "Searching/Quering Access" under the light of the discussion this morning
    *   Regarding Intelligent Services, some of them requires further elaboration, most of them are in a good shape.
    *   Regarding the Pub/Sub GE, figures are very nice but more explanations have to be given.   While reading it, the description of the CORBA Event Service came to my mind ... we need sections like the ones that were included in that spec describing what a consumer or a supplier was, what a channel was and how one entities interact with the others.   You may elaborate on the way these entities interact by simply describing the pictures you have already provided (suggestion: assign some numbering to operations in the figures and then describe the interaction following steps with the same numbering.
 *   In generating a new draft of your contribution, please take this document as the starting point (this is because I had to make some changes in the template I wouldn't like to miss in next drafts)
 *   I haven't yet added the contribution from ATOS because they were too preliminary.   Please take a look at the examples from Siemens and deliver something more elaborated.

  Next steps:

 *   I expect a new take from your side by tuesday June 7th EOB at the latest.   One action on you would have to do with adding points to the Security subsection I have added in section 3.1.3.
 *   I will send my notes from the rather relevant confcalls we had both yesterday (Publish/Subscribe Broker) and today (Query/Searching Access).   There will be some points in which I will try to describe the agreement we reached.   Authors of the sections describing the corresponding GEs will have to review these notes and try to implement the necessary changes in their descriptions to capture what we have agreed.   There will be other points that will still remain as points for further discussion.   Let's try to keep a thread of discussion over the email and see how much progress we achieve.   In general terms, agreements we reach should go to the description of GEs (or the Overview section) while points that remain open will finally go to the Question Marks section.
 *   I will start identifying the terms we should describe in a precise way.   I may also try to provide some definitions to incorporate in the next draft.

  Don't hesitate to send your comments/feedback to this planning.

  Best regards,

-- Juanjo

________________________________
Este mensaje se dirige exclusivamente a su destinatario. Puede consultar nuestra política de envío y recepción de correo electrónico en el enlace situado más abajo.
This message is intended exclusively for its addressee. We only send and receive email on the basis of the terms set out at.
http://www.tid.es/ES/PAGINAS/disclaimer.aspx
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fiware.org/private/old-fiware-data/attachments/20110601/ad643bb1/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: FI-WARE_High-Level_Description_11-06-1 Data-Context Management v1.0 11-06-01.doc
Type: application/msword
Size: 2912768 bytes
Desc: not available
URL: <https://lists.fiware.org/private/old-fiware-data/attachments/20110601/ad643bb1/attachment.doc>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: jhierro.vcf
Type: text/x-vcard
Size: 429 bytes
Desc: not available
URL: <https://lists.fiware.org/private/old-fiware-data/attachments/20110601/ad643bb1/attachment.vcf>