[Fiware-cloud-containers] FIWARE developer experience with Docker

Alex Glikson GLIKSON at il.ibm.com
Mon Jul 20 08:02:40 CEST 2015


Thanks, Juanjo. I assume we can use the regular TID bridge...
For those not on the invitation, the dial-in details are:

+ PIN: 050662
+ Local dial-in phone numbers at: 
http://pdf.powwownow.com/pdf/USA_en_pwn-dial-in-numbers.pdf

Talk to (most of) you at 11 CET then.

I am not entirely sure whether this will be productive for all the other 
architects who didn't participate the task force, though.. I will try 
giving a quick recap -- hopefully this would help.


Regards,
Alex

====================================================================================
Alex Glikson
Manager, Cloud Infrastructure Solutions, IBM Haifa Research Lab; FIWARE 
Cloud Leader & Architect
Email: glikson at il.ibm.com | Phone: +972-4-8281085 | Mobile: 
+972-54-6466667 | Fax: +972-4-8296112





From:   Juanjo Hierro <juanjose.hierro at telefonica.com>
To:     Alex Glikson/Haifa/IBM at IBMIL
Cc:     <fiware-cloud-containers at lists.fiware.org>, Philipp Slusallek 
<philipp.slusallek at dfki.de>
Date:   20/07/2015 08:22 AM
Subject:        Re: [Fiware-cloud-containers] FIWARE developer experience 
with Docker



Hi,

  Sorry that I didn't see your message and couldn't answer before ...

  For me, it's fine to change the time so that we start at 11:00am ... I 
have updated the invitation to the FIWARE Architects follow-up confcall 
where the discussion was going to be placed.

  Note that I'm currently in Mexico and there are 7 hours of difference. 
I'm not pretty sure whether I will be able to make it so please don't wait 
for me ... 

  Best regards,

-- Juanjo
______________________________________________________

Coordinator and Chief Architect, FIWARE platform
CTO Industrial IoT, Telefónica

email: juanjose.hierro at telefonica.com
twitter: @JuanjoHierro

You can follow FIWARE at:
  website:  http://www.fiware.org
  twitter:  @FIWARE
  facebook: http://www.facebook.com/pages/FI-WARE/251366491587242
  linkedIn: http://www.linkedin.com/groups/FIWARE-4239932

On 19/07/15 10:05, Alex Glikson wrote:
Can we do it 11am-1pm? Or maybe 11-12:30? Doodle indicated that this slot 
is available too. 
Juanjo -- were you going to update the architects meeting invitation 
(inviting additional people, etc), or should I send a separate one, with 
my bridge details? 

Thanks, 
Alex 

====================================================================================
Alex Glikson
Manager, Cloud Infrastructure Solutions, IBM Haifa Research Lab; FIWARE 
Cloud Leader & Architect
Email: glikson at il.ibm.com | Phone: +972-4-8281085 | Mobile: 
+972-54-6466667 | Fax: +972-4-8296112





From:        Juanjo Hierro <juanjose.hierro at telefonica.com> 
To:        Philipp Slusallek <philipp.slusallek at dfki.de>, Alex 
Glikson/Haifa/IBM at IBMIL, <fiware-cloud-containers at lists.fiware.org> 
Date:        09/07/2015 09:36 AM 
Subject:        Re: [Fiware-cloud-containers] FIWARE developer experience 
with Docker 



Hi all,

 Based on results from the doodle poll, we will setup the confcall on 
Monday 20th, from 09:30 to 11:30.

 Cheers,

-- Juanjo 
______________________________________________________

Coordinator and Chief Architect, FIWARE platform
CTO Industrial IoT, Telefónica

email: juanjose.hierro at telefonica.com
twitter: @JuanjoHierro

You can follow FIWARE at:
 website:  http://www.fiware.org
 twitter:  @FIWARE
 facebook: http://www.facebook.com/pages/FI-WARE/251366491587242
 linkedIn: http://www.linkedin.com/groups/FIWARE-4239932

On 08/07/15 09:45, Juanjo Hierro wrote: 

 I would suggest we setup a confcall to coordinate actions.

 Next architects confcall should be devoted to the discussion on POIs. 

 We may schedule the next architects confcall on July 20th on this matter 
or, try to plan a confcall earlier.

 Next week it is going to be difficult for José Manuel and myself.   José 
Manuel is travelling to Shangai this Friday and will come back Thursday 
next week.   Then, Friday 17th wouldn't work for Israel

 We could make it on Thursday from 12:00 to 14:00 or from 14:30 on, 
starting not later than 16:00 ...  otherwise go for the 20th.

 I have setup a doodle poll with the different options: 
http://doodle.com/66zyea2kiuh5vy98 

 Cheers,

-- Juanjo 
______________________________________________________

Coordinator and Chief Architect, FIWARE platform
CTO Industrial IoT, Telefónica

email: juanjose.hierro at telefonica.com
twitter: @JuanjoHierro

You can follow FIWARE at:
 website:  http://www.fiware.org
 twitter:  @FIWARE
 facebook: http://www.facebook.com/pages/FI-WARE/251366491587242
 linkedIn: http://www.linkedin.com/groups/FIWARE-4239932

On 08/07/15 07:46, Philipp Slusallek wrote: 
Hi all,

This all sounds good!

But what happened to your planned next meetings. FIC2 is still highly
interested in working with FIWARE to deploy the infrastructure developed
there (running on FIWARE Lab) also for FIWARE.

I thought the idea was to explore these options in a joint next call.

Best,

                Philipp

Am 30.06.2015 um 22:05 schrieb Juanjo Hierro:

Dear all,

 Thanks Alex for launching these discussions tracks.

 Regarding point (1) as anticipated by Alex, here it is the concrete
plan we aim at implementing to promote usage of docker tools by GE/SE
owners and the broader developer community. 

1. Make info about Docker images and instruction to setup docker
   containers linked to FIWARE GEris available in the FIWARE Catalogue:
     * We will specify a general template of a new section which will
       be included in the "Creating instances" tab of entries linked to
       FIWARE GEris.   This section will be elaborate on "Deploying a
       dedicated GE instance using Docker technology"
     * Each FIWARE GEri owner will be asked to setup a Docker image for
       their GEs and register it in Docker Hub.   This task can start
       in parallel to the previous one.
     * Each FIWARE GEri owner will be asked to update the "Creating
       instance" tab of the entry linked to the FIWARE GEri so that it
       provides instructions about deploying a dedicated instance of
       the GEri using docker.   For this purpose, the owner will follow
       the template defined in step 1. 
2. We will incorporate the description about how to create FIWARE GEri
   instances and try them using docker within the FIWARE Tour Guide for
   developers (which will effectively become the landing page of
   http://developers.fiware.org) as a mean to shorten the learning
   curve with FIWARE GEris
     * Somewhere at the beginning of the guided tour, we will explain
       the developer how he can setup the basic docker environment
       either locally or on the FIWARE Lab on which he will be able to
       rely to try the different FIWARE GEris (Group 1 scenarios
       described by Alex)
     * A demo application will be developed that will help the
       developer to try each FIWARE GEri instance deployed using docker
       with concrete data.  Developers will be able to deploy this
       application also using docker.  It is the intention that this
       application will be helpful to show how several FIWARE GEris can
       be used in an integrated way.
     * Each of the chapters of the FIWARE Tour guide for developers
       will integrate a "Try it yourself" section which will help the
       developer to create an instance of the FIWARE GEris referred in
       the chapter and try them.   In addition, developers will be able
       to deploy the demo application, in order to learn from a more
       elaborated example how the FIWARE GEris can be used, and
       providing instructions about how to play with the FIWARE GEris,
       also "tweak" the application.
     * Deployment of integrated FIWARE GEris and the demo application
       will be made feasible using docker composition tools


 José-Manuel Cantera will drive the implementation of these concrete
actions. 

 Regarding point 2, Bitergia has already developed a first bundle of
FIWARE GEris deployable using Docker compose (as a whole or
individually).   They will work in extending this bundle integrating
additional FIWARE GEris in collaboration with the corresponding FIWARE
GEri owners.   Bitergia and the ULPG will work together in the
development of a first version of the demo application.   Eventually,
additional partners might be incorporated as additional skills and/or
resources are needed.  We will address first those scenarios dealing
with local deployment, then we will incorporate those related to
deployment on other infrastructures such as the FIWARE Lab as soon as
the necessary preliminary work and/or detailed guidelines are completed
(this would be done under coordination by Alex and I assume we will
leverage on experience developed in FI-Content2).

 Feedback is welcome.

 Best regards,

-- Juanjo

______________________________________________________

Coordinator and Chief Architect, FIWARE platform
CTO Industrial IoT, Telefónica

email: juanjose.hierro at telefonica.com
twitter: @JuanjoHierro

You can follow FIWARE at:
 website:  http://www.fiware.org
 twitter:  @FIWARE
 facebook: http://www.facebook.com/pages/FI-WARE/251366491587242
 linkedIn: http://www.linkedin.com/groups/FIWARE-4239932

On 30/06/15 20:34, Alex Glikson wrote:

Dear partners,

Following the initial discussion at the containers task force, we
identified two follow-on (related) discussion tracks:
1) expected FIWARE Lab user/developer experience with Docker
2) Enhancements to FIWARE Cloud Hosting architecture to support Docker
(and enable requirements derived from #1)

This email refers to topic (1).

I will try to summarize the initial set of usage scenarios that we may
want to support. We can then iterate on this over email, and have a
phone call if needed, when we feel that we are close to a convergence
point.

Please, notice that I've subscribed several additional people relevant
for the discussion (who could provide input related to UI, developers
perspectives and operations perspectives).

*Assumptions*:
Notice that a prerequisite for all the usage scenarios is that all the
FIWARE GEs (and SEs) are packages as Docker images and are kept in a
central repository, preferably the docker hub (under a 'to-be-created'
"fiware" namespace). Also, there is an assumption that the
users/developers would want to work with Docker tools as much as
possible (surfacing some or all of the capabilities via the FIWARE
Cloud Portal too). Juanjo will elaborate on the approach we are
thinking of to promote this with GE/SE owners and the broader
developer community.

*Group 1: Basic Docker environment setup*
Usage scenario #1.1:
A user wants a local Docker runtime on his laptop.
He follows the standard instructions on setting up a docker host
(e.g., running within a VirtalBox VM, using docker-machine / boot2docker)

Usage scenario #1.2:
A user/developer wants to deploy a dedicated Docker VM on FIWARE Lab
(where he would then run various Docker containers).
He uses the standard docker-machine tool, specifying the URI of the
OpenStack Keystone in FIWARE Lab (and additional parameters, as
needed). The tool creates a VM using standard OpenStack APIs (natively
supported by FIWARE Lab) and configures Docker within the VM. The VM
would need to have a public IP (naturally).

*Group 2: Basic life cycle of individual containers running GEs/SEs*
Usage scenario #2.1:
A developer wants to publish (a version of) a GE/SE.
After he is done creating the new Docker image, he pushes the new
version of the GE/SE to Docker hub under corresponding FIWARE
namespace (e.g., fiware/GE/cb-orion). Now the 'latest' version of the
image points to the new version.

Usage scenario #2.2:
A user/developer wants to deploy locally an instance of a certain GE/SE.
He uses the standard docker CLI to locally provision a container,
referring to the corresponding image at Docker hub -- e.g.: /"$ docker
-H boot2docker-vm:2376 run fiware/GE/cb-orion"/

Usage scenario #2.3:
A user/developer wants to deploy an instance of a certain GE/SE within
his Docker VM on FIWARE Lab
He uses the standard docker CLI to provision a container, referring to
the location of his Docker VM as well as the corresponding image at
Docker hub -- e.g.: /"$ docker -H mydocker-vm37.lab.fiware.org:2376
run fiware/GE/cb-orion". /ISSUE: the user would need to open the
corresponding firewall ports in his VM (same as those of the GE/SE, or
following the mapping performed during container provisioning) in
order to make the GE/SE accessible. Ideally, this should be done in a
scalable but secure manner. An easy solution is to open up-front
(during VM provisioning) a range of ports (via setting up
corresponding security group). A more advanced solution is to update
the security group dynamically.

Usage scenario #2.4:
A user/developer wants to update a container comprising certain GE/SE
with the latest version recently published in the dedicated namespace
of the Docker Hub.
He pulls the latest version from the Docker Hub, kills the old
container, and starts a new one (attaching to the same resources).
Note that this would work well when the application is properly
designed for Docker (e.g., the container itself is stateless), and
when the previous version of the container has been provisioned
manually (as in #2, #4 above) by the developer (and he knows which
resources to connect to).

*Group 3: Support for 'bundles' of GEs/SEs that together perform a
certain complex function*
Usage scenario #3.1:
A developer wants to publish (a version of) a 'bundle' of GEs/SEs that
together perform a certain complex function.
He creates a 'template' (e.g., following the format of
docker-compose), referring to the individual GE/SE images as well as
their interdependencies (e.g., links) and other composition
properties. This might be done using a text editor, a Web UI provided
by the FIWARE Cloud (conceptually similar to today's UI for creation
of blueprints), or other tools from Docker ecosystem. He then uploads
the template to the centralized templats repository. Note: it is
likely that docker-compose will be able to use Docker Registry/Hub as
a repository for templates (including versioning, push/pull, etc).

Usage scenario #3.2:
A user wants to provision locally a set of GEs/SEs, using a
pre-defined template (comprising a 'bundle')
He uses the standard docker-compose tool referring to the 'template'
artifcat as well as the local Docker URL.

Usage scenario #3.3:
A user wants to provision a set of GEs/SEs in FIWARE Lab, using a
pre-defined template (comprising a 'bundle')
He uses the standard docker-compose tool referring to the 'template'
artifcat as well as the target Docker URL in FIWARE Lab.
Alternatively, he uses the FIWARE Portal UI to do the same (e.g., with
Murano backend invoking docker-compose).

Usage scenario #3.4:
A user wants to update his Docker environment (local or on FIWARE Lab)
with the latest version of a certain 'bundle'
Note: may require enancements to docker-compose

*Group 4: Advanced scenarios*
Usage scenario #4.1:
A user/developer wants to provision a cluster of VMs on FIWARE Lab
that would host his Docker cluster (managed with Swarm or Kubernetes)
He uses corresponding Murano/Heat template to provision the VMs and to
configure the Docker/Swarm/Kubernetes cluster.

Usage scenario #4.2:
A user/developer wants to access a global instance of a Docker service
in FIWARE Lab (shared, scalable, managed), so that he doesn't need to
manage the corresponding VM(s) by himself.
He authenticates with FIWARE Lab, and starts accessing the FIWARE Lab
Docker API endpoint with the standard Docker tools or FIWARE-specific
tools (as outlined above ).

Usage scenario #4.3:
A user/developer wants to manage access control for Docker images
among FIWARE Lab users.
He starts using the Docker Registry/Hub deployed within the FIWARE Lab.


Notice that this is a very initial list -- I am sure that there are
many inaccuracies and gaps. Feel free to comment.

Thanks,
Alex

====================================================================================
Alex Glikson
Manager, Cloud Infrastructure Solutions, IBM Haifa Research Lab
Email: glikson at il.ibm.com | Phone: +972-4-8281085 | Mobile:
+972-54-6466667 | Fax: +972-4-8296112



_______________________________________________
Fiware-cloud-containers mailing list
Fiware-cloud-containers at lists.fiware.org
https://lists.fiware.org/listinfo/fiware-cloud-containers


------------------------------------------------------------------------

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario,
puede contener información privilegiada o confidencial y es para uso
exclusivo de la persona o entidad de destino. Si no es usted. el
destinatario indicado, queda notificado de que la lectura, utilización,
divulgación y/o copia sin autorización puede estar prohibida en virtud
de la legislación vigente. Si ha recibido este mensaje por error, le
rogamos que nos lo comunique inmediatamente por esta misma vía y proceda
a su destrucción.

The information contained in this transmission is privileged and
confidential information intended only for the use of the individual or
entity named above. If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this communication is strictly prohibited. If you have
received this transmission in error, do not read it. Please immediately
reply to the sender that you have received this communication in error
and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu
destinatário, pode conter informação privilegiada ou confidencial e é
para uso exclusivo da pessoa ou entidade de destino. Se não é vossa
senhoria o destinatário indicado, fica notificado de que a leitura,
utilização, divulgação e/ou cópia sem autorização pode estar proibida em
virtude da legislação vigente. Se recebeu esta mensagem por erro,
rogamos-lhe que nos o comunique imediatamente por esta mesma via e
proceda a sua destruição


_______________________________________________
Fiware-cloud-containers mailing list
Fiware-cloud-containers at lists.fiware.org
https://lists.fiware.org/listinfo/fiware-cloud-containers





Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, 
puede contener información privilegiada o confidencial y es para uso 
exclusivo de la persona o entidad de destino. Si no es usted. el 
destinatario indicado, queda notificado de que la lectura, utilización, 
divulgación y/o copia sin autorización puede estar prohibida en virtud de 
la legislación vigente. Si ha recibido este mensaje por error, le rogamos 
que nos lo comunique inmediatamente por esta misma vía y proceda a su 
destrucción.

The information contained in this transmission is privileged and 
confidential information intended only for the use of the individual or 
entity named above. If the reader of this message is not the intended 
recipient, you are hereby notified that any dissemination, distribution or 
copying of this communication is strictly prohibited. If you have received 
this transmission in error, do not read it. Please immediately reply to 
the sender that you have received this communication in error and then 
delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, 
pode conter informação privilegiada ou confidencial e é para uso exclusivo 
da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário 
indicado, fica notificado de que a leitura, utilização, divulgação e/ou 
cópia sem autorização pode estar proibida em virtude da legislação 
vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o 
comunique imediatamente por esta mesma via e proceda a sua destruição


_______________________________________________
Fiware-cloud-containers mailing list
Fiware-cloud-containers at lists.fiware.org
https://lists.fiware.org/listinfo/fiware-cloud-containers




Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, 
puede contener información privilegiada o confidencial y es para uso 
exclusivo de la persona o entidad de destino. Si no es usted. el 
destinatario indicado, queda notificado de que la lectura, utilización, 
divulgación y/o copia sin autorización puede estar prohibida en virtud de 
la legislación vigente. Si ha recibido este mensaje por error, le rogamos 
que nos lo comunique inmediatamente por esta misma vía y proceda a su 
destrucción.

The information contained in this transmission is privileged and 
confidential information intended only for the use of the individual or 
entity named above. If the reader of this message is not the intended 
recipient, you are hereby notified that any dissemination, distribution or 
copying of this communication is strictly prohibited. If you have received 
this transmission in error, do not read it. Please immediately reply to 
the sender that you have received this communication in error and then 
delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, 
pode conter informação privilegiada ou confidencial e é para uso exclusivo 
da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário 
indicado, fica notificado de que a leitura, utilização, divulgação e/ou 
cópia sem autorização pode estar proibida em virtude da legislação 
vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o 
comunique imediatamente por esta mesma via e proceda a sua destruição 



Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, 
puede contener información privilegiada o confidencial y es para uso 
exclusivo de la persona o entidad de destino. Si no es usted. el 
destinatario indicado, queda notificado de que la lectura, utilización, 
divulgación y/o copia sin autorización puede estar prohibida en virtud de 
la legislación vigente. Si ha recibido este mensaje por error, le rogamos 
que nos lo comunique inmediatamente por esta misma vía y proceda a su 
destrucción.

The information contained in this transmission is privileged and 
confidential information intended only for the use of the individual or 
entity named above. If the reader of this message is not the intended 
recipient, you are hereby notified that any dissemination, distribution or 
copying of this communication is strictly prohibited. If you have received 
this transmission in error, do not read it. Please immediately reply to 
the sender that you have received this communication in error and then 
delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, 
pode conter informação privilegiada ou confidencial e é para uso exclusivo 
da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário 
indicado, fica notificado de que a leitura, utilização, divulgação e/ou 
cópia sem autorização pode estar proibida em virtude da legislação 
vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o 
comunique imediatamente por esta mesma via e proceda a sua destruição
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fiware.org/private/fiware-cloud-containers/attachments/20150720/e32655e1/attachment.html>


More information about the Fiware-cloud-containers mailing list

You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy   Cookies policy