[Fiware-lab-federation-nodes] Migration Plan After Open Call Results

[Cristian Cristelotti]

LAST LOGS


******************** nova ********************
2016-02-26 18:38:19.879 23774 WARNING keystoneclient.middleware.auth_token [-] Authorization failed for token
2016-02-26 18:38:19.879 23774 INFO keystoneclient.middleware.auth_token [-] Invalid user token - rejecting request
2016-02-26 18:38:19.880 23774 INFO nova.osapi_compute.wsgi.server [-] 79.77.133.209,130.206.84.8 "GET /v2/00000000000000000000000000008350/flavors/detail HTTP/1.1" status: 401 len: 227 time: 0.0020950


********************neutron ********************
2016-02-26 18:42:04.649 8192 ERROR keystoneclient.middleware.auth_token [req-92be2c94-0820-4cb9-a817-0aa912941b33 ] HTTP connection exception: HTTPConnectionPool(host='cloud.lab.fiware.org', port=4731): Max retries exceeded with url: / (Caused by <class 'httplib.BadStatusLine'>: '')
2016-02-26 18:42:04.649 8192 WARNING keystoneclient.middleware.auth_token [req-92be2c94-0820-4cb9-a817-0aa912941b33 ] Authorization failed for token
2016-02-26 18:42:04.650 8192 INFO keystoneclient.middleware.auth_token [req-92be2c94-0820-4cb9-a817-0aa912941b33 ] Invalid user token - rejecting request
2016-02-26 18:42:04.650 8192 INFO neutron.wsgi [req-92be2c94-0820-4cb9-a817-0aa912941b33 None] 192.168.0.20 - - [26/Feb/2016 18:42:04] "GET /v2.0/ports.json?tenant_id=6b5e128ba10b47cc905b1ad66fd01c4f&device_id=969e1a22-8479-4bbb-a286-a51d6d457688 HTTP/1.1" 401 268 4.032209






----- Messaggio originale -----
Da: "JOSE IGNACIO CARRETERO GUARDE" <joseignacio.carreteroguarde at telefonica.com>
A: "Cristian Cristelotti" <cristian.cristelotti.coll at trentinonetwork.it>, "FERNANDO LOPEZ AGUILAR" <fernando.lopezaguilar at telefonica.com>
Cc: fiware-lab-federation-nodes at lists.fiware.org, "Álvaro Alonso" <aalonsog at dit.upm.es>
Inviato: Venerdì, 26 febbraio 2016 12:39:35
Oggetto: Re: [Fiware-lab-federation-nodes] Migration Plan After Open Call Results

Dear Cristian,

The responses you get are: 404 --- The tokens your are sending are not
OK. Maybe if you restarted the APIs this could improve.

{"error": {"message": "Could not find token: xxxxxx", "code": 404,
"title": "Not Found"}}

If tokens are not found, means that they are old and d

Regards,
José Ignacio.
El 26/02/16 a las 12:02, Cristian Cristelotti escribió:
> Hi again,
>
> sorry to bother you but the users using the TrentoNode are claiming they can't be use the cloud portal since 24/02/2016.
>  From wednesday 24, we are also blocked in the migration process to Kilo.
>
> Please give us a way to solve the problem.
>
> Regards
>
> Cristian
>
> ----- Messaggio originale -----
> Da: "FERNANDO LOPEZ AGUILAR" <fernando.lopezaguilar at telefonica.com>
> A: "Cristian Cristelotti" <cristian.cristelotti.coll at trentinonetwork.it>, "Riwal KERHERVE" <rkerherve at images-et-reseaux.com>, "Theofanis Katsiaounis" <th_katsiaounis at neuropublic.gr>
> Cc: fiware-lab-federation-nodes at lists.fiware.org, "Álvaro Alonso" <aalonsog at dit.upm.es>
> Inviato: Giovedì, 25 febbraio 2016 15:34:34
> Oggetto: Re: [Fiware-lab-federation-nodes] Migration Plan After Open Call Results
>
> Dear all,
>
> Sorry, but we was investigating the different issues in the process to validate tokens
> and I have no time to response this issue.
>
> How you mention, one of the solutions is to take a snapshot of the image and move it to
> other node, for sure it works but you have to take into account that the destination node
> have to maintain the snapshots of the original image. The reason is that if you delete
> this snapshot and the VM is stopped and restart again, without this image you cannot start
> it again. The problem is that for only one could not be a problem, but if you move 100’s
> of them you have to keep 9Gb data for each of them.
>
> The second option, less clean, you can take the image of the extended file system and put
> over a base image, taking into account that we have to modify some binary data in the new
> Created VM in order to make reference to the base image of the new region. It is something
> That we did in the past but should be checked.
>
> The third option, the least clean, consists on take a complete image of the filesystem of the
> image and recover it in the destination node in the same image that we have in the original
> node. This operation have to be done outside of the VM.
>
> IMHO the best is the least clean.
>
> Fernando.-
>
>
>
>
>
>
>
>
> On 25/02/16 14:55, "Cristian Cristelotti" <cristian.cristelotti.coll at trentinonetwork.it> wrote:
>
>> Same for us in Trento.
>>
>> We've done a little script to save all VMs, transfer the snapshots and create the commands (glance image-create ... )  to launch the snapshots on the new node.
>>
>> Cristian
>>
>> ----- Messaggio originale -----
>> Da: "Riwal KERHERVE" <rkerherve at images-et-reseaux.com>
>> A: "Theofanis Katsiaounis" <th_katsiaounis at neuropublic.gr>, "FERNANDO LOPEZ AGUILAR" <fernando.lopezaguilar at telefonica.com>, "Álvaro Alonso" <aalonsog at dit.upm.es>
>> Cc: fiware-lab-federation-nodes at lists.fiware.org
>> Inviato: Giovedì, 25 febbraio 2016 14:49:29
>> Oggetto: Re: [Fiware-lab-federation-nodes] Migration Plan After Open Call Results
>>
>>
>>
>>
>>
>> Theofanis,
>>
>>
>>
>> Some answers below in your mail.
>>
>>
>>
>> BR
>>
>>
>> Riwal
>> Kerherve
>>
>>
>> { T }
>>
>> + 33 ( 0 ) 2 56 35 85 04
>>
>>
>> { M }
>>
>> + 33 ( 0 ) 6 83 64 25 94
>>
>>
>>
>>
>>
>>
>>
>> De : fiware-lab-federation-nodes-bounces at lists.fiware.org [mailto:fiware-lab-federation-nodes-bounces at lists.fiware.org] De la part de Theofanis Katsiaounis
>> Envoyé : lundi 22 février 2016 10:28
>> À : FERNANDO LOPEZ AGUILAR; Álvaro Alonso
>> Cc : fiware-lab-federation-nodes at lists.fiware.org
>> Objet : Re: [Fiware-lab-federation-nodes] Migration Plan After Open Call Results
>>
>>
>>
>> Dear Fernando,all
>> since we are in the process of migrating our vm's to other nodes can we have any tips on how to do that more efficiently?
>> I believe the process should be to create a snapshot and then tranfer the snapshot to the new node glance???
>>
>> RKE : Yes this is how in Lannion we had proceed for Juno and will proceed for Kilo.
>>
>> Will we be able to transfer our images directly to other node glance servers?
>>
>> RKE: I think you should ask to Fernando to put your new node in the config of the “automatic image update tool”.
>>
>>
>>
>> Thanks a lot in advance,
>> Fanis
>>
>>
>> On 18/02/2016 02:45 μμ, FERNANDO LOPEZ AGUILAR wrote:
>>
>>
>>
>>
>>
>>
>> FYI, we update the repo with the last changes in order to resolve the problems that were identified by Theofanis.
>>
>>
>>
>>
>>
>> I hope that now you can use it.
>>
>>
>>
>>
>>
>> Fernando.-
>>
>>
>>
>>
>>
>> From: Theofanis Katsiaounis < th_katsiaounis at neuropublic.gr >
>> Date: Thursday 18 February 2016 at 12:40
>> To: fla < fernando.lopezaguilar at telefonica.com >, Álvaro Alonso < aalonsog at dit.upm.es >
>> Cc: " fiware-lab-federation-nodes at lists.fiware.org " < fiware-lab-federation-nodes at lists.fiware.org >
>> Subject: Re: [Fiware-lab-federation-nodes] Migration Plan After Open Call Results
>>
>>
>>
>>
>>
>>
>> Dear Fernando,
>> i tried the proposed solution and it failed again.
>> I then noticed it tries to load OpenstackMap module which in the skuld
>> folder is called as OpenStackMap.
>> Changed in users.py line 48 the name to OpenStackMap and it worked.
>> However now i get this:
>>
>> Getting administrator token...
>> Getting id of the requested region...
>> Getting the list of projects in the specific region...
>> Get the list of users with some role on those projects...
>> Getting the email of the identified users...
>> Making analysis bottom-up...
>> Traceback (most recent call last):
>> File "./users.py", line 320, in <module>
>> getusers = processing_request(arguments)
>> File "./users.py", line 306, in processing_request
>> useremail_osclient = get_email_osclient(username=username,
>> password=password, region=region)
>> File "./users.py", line 237, in get_email_osclient
>> map.load_keystone()
>> File "/root/download/fiware-skuld/skuld/openstackmap.py", line 572,
>> in load_keystone
>> self._get_keystone_data()
>> File "/root/download/fiware-skuld/skuld/openstackmap.py", line 215,
>> in _get_keystone_data
>> keystone = self.osclients.get_keystoneclientv3()
>> File "/root/download/fiware-skuld/utils/osclients.py", line 585, in
>> get_keystoneclientv3
>> session = self.get_session_v3()
>> File "/root/download/fiware-skuld/utils/osclients.py", line 440, in
>> get_session_v3
>> self._apply_override_endpoint(**override)
>> File "/root/download/fiware-skuld/utils/osclients.py", line 680, in
>> _apply_override_endpoint
>> endpoints = list(endp for endp in self.get_endpoints(service_type)
>> File "/root/download/fiware-skuld/utils/osclients.py", line 615, in
>> get_endpoints
>> for service in self.get_catalog():
>> File "/root/download/fiware-skuld/utils/osclients.py", line 597, in
>> get_catalog
>> access = session.auth.get_access(session)
>> File
>> "/usr/lib/python2.7/dist-packages/keystoneclient/auth/identity/base.py",
>> line 126, in get_access
>> self.auth_ref = self.get_auth_ref(session)
>> File
>> "/usr/lib/python2.7/dist-packages/keystoneclient/auth/identity/v3.py",
>> line 119, in get_auth_ref
>> authenticated=False, log=False, **rkwargs)
>> File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py",
>> line 430, in post
>> return self.request(url, 'POST', **kwargs)
>> File "/usr/lib/python2.7/dist-packages/keystoneclient/utils.py", line
>> 318, in inner
>> return func(*args, **kwargs)
>> File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py",
>> line 346, in request
>> raise exceptions.from_response(resp, method, url)
>> keystoneclient.openstack.common.apiclient.exceptions.NotFound: The
>> resource could not be found. (HTTP 404)
>>
>>
>>
>> On 18/02/2016 01:30 μμ, FERNANDO LOPEZ AGUILAR wrote:
>>> $ export PYTHONPATH=../..
>>
>>
>> Αποποίηση ευθυνών / Disclaimer
>>
>>
>>
>>
>>
>>
>> Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.
>>
>> The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.
>>
>> Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
>>
>>
>>
>>
>> Αποποίηση ευθυνών / Disclaimer
>> _______________________________________________
>> Fiware-lab-federation-nodes mailing list
>> Fiware-lab-federation-nodes at lists.fiware.org
>> https://lists.fiware.org/listinfo/fiware-lab-federation-nodes
>>
>> --
>> Cristian Cristelotti
>>
>> Collaboratore di Trentino Network Srl
>>
>>
>>
>>
> ________________________________
>
> Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.
>
> The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.
>
> Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
>

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição

-- 
Cristian Cristelotti

Collaboratore di Trentino Network Srl