[Fiware-lab-federation-nodes] Unauthorized (HTTP 401) problem

Spyros Argyropoulos spyros at intelligence.tuc.gr
Thu Feb 25 10:52:32 CET 2016


Same problem in Crete.
We need to know if there was any change in the way openstack services 
take authorization.

Thank you,

Spyros.

Spyros Argyropoulos, Computer & Informatics Eng.
Intelligent Systems Laboratory
School of Electronic and Computer Engineering
Technical University of Crete
University Campus - Kounoupidiana
73100 Chania, Crete
GREECE
Phone: +3028210 37342
Fax: +3028210 37542

On 25/2/2016 11:37 πμ, Cristian Cristelotti wrote:
> Hi All,
>
> since yesterday morning Trento is getting "ERROR (Unauthorized): Unauthorized (HTTP 401)".
> We were supposed to start migrating VMs to the new node and this issue is blocking us.
>
> We informed Alvaro as responsible of Keystone to check and fix the issue.
>
> Also we received some complains from user that can't manage the VMs from cloud-portal.
>
> Can you please support us?
>
> Thank you
>
> Cristian
>
>
>
> ----- Messaggio originale -----
> Da: "Ariel Otilibili Anieli" <ariel.otilibili-anieli at com4innov.com>
> A: "Cristian Cristelotti" <cristian.cristelotti.coll at trentinonetwork.it>, spyros at intelligence.tuc.gr, aalonsog at dit.upm.es
> Cc: fiware-lab-federation-nodes at lists.fiware.org, support at com4innov.com
> Inviato: Mercoledì, 24 febbraio 2016 17:52:10
> Oggetto: Re: [Fiware-lab-federation-nodes] Unauthorized (HTTP 401) problem
>
> Hello Álvaro,
> All nodes (but Zurich and Madrid) are down. On this matter, see the mail
> log, Spýros (from Crete), Christian (from Trento) and I (Sophia
> Antipolis) have been talking over.
> At our side, all services are up; our check is sane. May you help to
> work this around?
> Regards,
>
> Ariel Otilibili Anieli
> 00 33 (0)6 28 11 87 30
>
> Le 24/02/2016 17:28, Cristian Cristelotti a écrit :
>> Trento still facing the problem
>>
>> ----- Messaggio originale -----
>> Da: "Ariel Otilibili Anieli" <ariel.otilibili-anieli at com4innov.com>
>> A: spyros at intelligence.tuc.gr, "Cristian Cristelotti" <cristian.cristelotti.coll at trentinonetwork.it>
>> Cc: fiware-lab-federation-nodes at lists.fiware.org, support at com4innov.com
>> Inviato: Mercoledì, 24 febbraio 2016 16:45:23
>> Oggetto: Re: [Fiware-lab-federation-nodes] Unauthorized (HTTP 401) problem
>>
>> At our side, Spýro; it works:
>>
>> root at node-1:~# nova list --all-tenants
>> +--------------------------------------+-------------------------+--------+------------+-------------+-------------------------------------------------+
>> | ID | Name | Status | Task State | Power State | Networks |
>> +--------------------------------------+-------------------------+--------+------------+-------------+-------------------------------------------------+
>> | 7c412711-679d-475f-affb-2fc04234d1f7 | Centos7x64_EGM_IoTAgent | ACTIVE | - | Running | node-int-net-01=192.168.111.175, 193.48.247.247 |
>> | 2dff52e5-5cfa-4e57-ba3b-903ac4974615 | Context Broker C4I | ACTIVE | - | Running | node-int-net-01=192.168.111.229, 193.48.247.240 |
>> | 1150d022-ce96-42a4-b097-0bbc1b38bcf4 | EGM_EsperTest | ACTIVE | - | Running | node-int-net-01=192.168.111.116 |
>> | fc18456f-b584-4113-b23d-f7a5974b4f1e | Git Fiesta | ACTIVE | - | Running | node-int-net-01=192.168.111.14, 193.48.247.239 |
>> | 3ab26e72-5507-476f-b2bc-6dd46418d12a | IOT Agent C4I | ACTIVE | - | Running | node-int-net-01=192.168.111.239, 193.48.247.231 |
>> | ade1b2f1-ed4e-4597-9166-6576154470ae | OCB_OneM2M | ACTIVE | - | Running | node-int-net-01=192.168.111.150 |
>> | aedaa83e-ed00-49c6-933d-7c33a502b869 | OrionCB_EGM_Instance | ACTIVE | - | Running | node-int-net-01=192.168.111.180, 193.48.247.246 |
>> | f96099b1-5f58-4dbb-828f-2eb7869092ab | Ubuntu14.04GitLab | ACTIVE | - | Running | node-int-net-01=192.168.111.16, 193.48.247.201 |
>> | 7ad0c331-513c-4833-b731-fe108425c9fa | cloud1 | ACTIVE | - | Running | node-int-net-01=192.168.111.237, 193.48.247.221 |
>> | 44b64155-d82e-4770-a99c-626d739a7b3d | cygnus_Mongo | ACTIVE | - | Running | node-int-net-01=192.168.111.128, 193.48.247.223 |
>> | 78542f35-b685-4a1e-89df-d5feb1d0c958 | iot | ACTIVE | - | Running | node-int-net-01=192.168.111.130 |
>> | 9550f433-7768-4bab-ab86-5370f52e9f93 | pol1 | ACTIVE | - | Running | node-int-net-01=192.168.111.6, 193.48.247.208 |
>> | dd9c35c3-5c32-4486-af04-20f912b0a0d9 | pol2 | ACTIVE | - | Running | node-int-net-01=192.168.111.7, 193.48.247.209 |
>> | 30a3ff06-c088-4188-8ee7-4aa95b86431c | sofm2 | ACTIVE | - | Running | node-int-net-01=192.168.111.152 |
>> | 53974bba-cc28-4a81-9825-5b8962a63dad | sofp | ACTIVE | - | Running | node-int-net-01=192.168.111.154 |
>> | 7cfb54bb-822a-4d11-ab22-99ae5a674fa8 | sofp2 | ACTIVE | - | Running | node-int-net-01=192.168.111.156 |
>> | 42b6d86e-99f7-44e6-a6d7-b5f62c600d4a | sofp51 | ACTIVE | - | Running | node-int-net-01=192.168.111.168 |
>> | 04aee247-5d08-4c89-9078-ce73c23ab2fa | sofp52 | ACTIVE | - | Running | node-int-net-01=192.168.111.170 |
>> | 4e639089-076d-413f-af50-f92cf101a215 | sofsav | ACTIVE | - | Running | node-int-net-01=192.168.111.135 |
>> | 0ce39f07-d3a2-4fe9-9f87-04a5e5c406ab | sophia2ptres | ACTIVE | - | Running | node-int-net-01=192.168.111.171 |
>> | d176eb89-f95a-41b5-823e-a6b6835deb54 | sophia2ptres2 | ACTIVE | - | Running | node-int-net-01=192.168.111.172 |
>> | 9d1ef14a-5d83-4301-9cf5-031d6e0c2094 | sophia2xet | ACTIVE | - | Running | node-int-net-01=192.168.111.158 |
>> | 25cf7a4c-9a06-4eb5-a824-bfd3053a5ec9 | sophia2xet2 | ACTIVE | - | Running | node-int-net-01=192.168.111.164 |
>> | 9ba8d34b-daa4-438a-bb3e-ba4f85d2bbb4 | test1 | ACTIVE | - | Running | node-int-net-01=192.168.111.169 |
>> | 872fe670-a1e0-4147-87d6-74a0cdc0b6c0 | test2 | ACTIVE | - | Running | node-int-net-01=192.168.111.173 |
>> | 112f82d2-40f3-4dca-b257-a41db0ed9bea | test3 | ACTIVE | - | Running | node-int-net-01=192.168.111.174 |
>> | 602843dc-311f-45ff-9fab-9803f3c122cf | test3 | ACTIVE | - | Running | ext=192.168.0.2, 193.48.247.206 |
>> | 61448d5c-4171-4817-8628-9c9a7ed16d45 | test4 | ACTIVE | - | Running | node-int-net-01=192.168.111.176 |
>> | c1b06377-6f86-4039-aa2a-1bb0eed53350 | test5 | ACTIVE | - | Running | node-int-net-01=192.168.111.177 |
>> | 01315eeb-c829-4019-97c0-b3511d0cf3aa | test6 | ACTIVE | - | Running | node-int-net-01=192.168.111.178 |
>> +--------------------------------------+-------------------------+--------+------------+-------------+-------------------------------------------------+
>> root at node-1:~# nova list
>>
>> On Nagios, all service are up; and all nodes are down, but Zurich and Spain.
>> I can't square this circle...
>> Ariel Otilibili Anieli
>> 00 33 (0)6 28 11 87 30
>> Le 24/02/2016 16:06, Spyros Argyropoulos a écrit :
>>
>>
>> The logs were from /var/log/neutron/server.log (for juno)
>> Also notice we have problem with CLIs, e.g.
>> # nova list
>> ERROR (Unauthorized): Unauthorized (HTTP 401) (Request-ID: req-1de02ff2-d91c-4891-a7fd-7e586e1f3046)
>>
>> Spyros.
>>
>> ___________________________________________
>> Spyros Argyropoulos, Computer & Informatics Eng.
>> Intelligent Systems Laboratory
>> Department of Electronic and Computer Engineering
>> Technical University of Crete
>> University Campus - Kounoupidiana
>> 73100 Chania, Crete
>> GREECE
>> Phone: +3028210 37342
>> Fax: +3028210 37542
>>
>> On 2/24/2016 4:25 PM, Ariel Otilibili Anieli wrote:
>>
>>
>> Hi Spýro,
>> So do we: Keystone up, but others services down (as you). I went through this log:
>>
>> root at node-1:~# tail -f /var/log/keystone/keystone-all.log
>> 2016-02-24 12:38:59.243 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 12:38:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.134585
>> 2016-02-24 12:48:59.370 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 12:48:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.155716
>> 2016-02-24 12:58:59.445 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 12:58:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.161786
>> 2016-02-24 13:08:59.433 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 13:08:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.144382
>> 2016-02-24 13:18:59.564 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 13:18:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.155842
>> 2016-02-24 13:28:59.658 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 13:28:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.160769
>> 2016-02-24 13:38:59.741 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 13:38:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.159837
>> 2016-02-24 13:48:59.860 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 13:48:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.162100
>> 2016-02-24 13:58:59.892 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 13:58:59] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.154368
>> 2016-02-24 14:09:00.004 5297 INFO eventlet.wsgi.server [-] 192.168.252.4 - - [24/Feb/2016 14:09:00] "POST /v2.0/tokens HTTP/1.1" 200 3927 0.162309
>>
>> And that one:
>> root at node-1:~# tail -f /var/log/keystone/keystone-manage.log
>> 2015-05-12 17:04:41.184 49441 INFO migrate.versioning.api [-] 39 -> 40...
>> 2015-05-12 17:04:41.221 49441 INFO migrate.versioning.api [-] done
>> 2015-05-12 17:04:41.222 49441 INFO migrate.versioning.api [-] 40 -> 41...
>> 2015-05-12 17:04:41.236 49441 INFO migrate.versioning.api [-] done
>> 2015-05-12 17:04:41.237 49441 INFO migrate.versioning.api [-] 41 -> 42...
>> 2015-05-12 17:04:41.259 49441 INFO migrate.versioning.api [-] done
>> 2015-05-12 17:04:41.259 49441 INFO migrate.versioning.api [-] 42 -> 43...
>> 2015-05-12 17:04:41.267 49441 INFO migrate.versioning.api [-] done
>> 2015-05-12 17:04:41.267 49441 INFO migrate.versioning.api [-] 43 -> 44...
>> 2015-05-12 17:04:41.289 49441 INFO migrate.versioning.api [-] done
>>
>> But, still, couldn't see when you got your output. Where had you looked into?
>> Regards,
>>
>> Ariel Otilibili Anieli
>> 00 33 (0)6 28 11 87 30
>>
>> Le 24/02/2016 14:47, Cristian Cristelotti a écrit :
>>
>>
>> Same for Trento!!!
>>
>> Cristian
>>
>> ----- Messaggio originale -----
>> Da: "Spyros Argyropoulos" <spyros at intelligence.tuc.gr>
>> A: fiware-lab-federation-nodes at lists.fiware.org
>> Inviato: Mercoledì, 24 febbraio 2016 14:36:47
>> Oggetto: [Fiware-lab-federation-nodes] Unauthorized (HTTP 401) problem
>>
>> Hi all,
>>
>> Today sanity tests did not work for the Region of Crete because we got a
>> 'Unauthorized (HTTP 401)' message for all of them.
>> It seems we have lost connection with central keystone as we get
>> messages in our logs like the following:
>>
>> 2016-02-24 13:32:39.423 6873 WARNING keystonemiddleware.auth_token [-]
>> Retrying on HTTP connection exception: Unable to establish connection to
>> http://cloud.lab.fiware.org:4731/
>> 2016-02-24 13:32:40.156 6873 WARNING keystonemiddleware.auth_token [-]
>> Retrying on HTTP connection exception: Unable to establish connection to
>> http://cloud.lab.fiware.org:4731/
>> 2016-02-24 13:32:41.388 6873 WARNING keystonemiddleware.auth_token [-]
>> Retrying on HTTP connection exception: Unable to establish connection to
>> http://cloud.lab.fiware.org:4731/
>> 2016-02-24 13:32:43.618 6873 ERROR keystonemiddleware.auth_token [-]
>> HTTP connection exception: Unable to establish connection to
>> http://cloud.lab.fiware.org:4731/
>>
>> As I can see Trento has the same problem.
>> Any ideas...
>>
>> Thank you,
>>
>> Spyros.
>>
>




More information about the Fiware-lab-federation-nodes mailing list

You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy   Cookies policy