[Fiware-tech-help] [FI-WARE-JIRA] (HELP-3762) FIWARE.Request.Lab.Data.BigData-Analysis.UnsuccessfullDataSaving

FRANCISCO ROMERO BUENO francisco.romerobueno at telefonica.com
Tue Aug 11 09:17:14 CEST 2015


Hi Sergio,

You are not able to perform such an operation from outside because you
have to append to the request an OAuth2 token (and use HttpFS port
instead, see later). This is because the WebHDFS interface authentication
and authorization mechanisms were recently moved to OAuth2. There was a
general announcement, nevertheless if you missed it, you have all the
details in this stack overflow.com question:

http://stackoverflow.com/questions/31187977/oauth2-access-to-cosmos-webhdfs
-in-fiware-lab

Additionally, as said, we are using the HttpFS port (14000 instead of
50070) because this allows us to hide the cluster details from the outside.

Please, follow the guide above and tell me if you have any doubts.

Regarding the enabler documentation, we are working hard to update it, it
should be ready in the following days.

Regards,
Francisco


El 8/8/15 0:45, "FW External User (JIRA)" <jira-help-desk at fi-ware.org>
escribió:

>
>     [
>https://jira.fiware.org/browse/HELP-3762?page=com.atlassian.jira.plugin.sy
>stem.issuetabpanels:all-tabpanel ]
>
>FW External User updated HELP-3762:
>-----------------------------------
>
>Yes Francisco, I'm talking about WebHDFS REST API.
>
>I tried to execute the API call:
>
>
>
>curl -i
>"http://cosmos.lab.fi-ware.org:50070/webhdfs/v1/tmp?user.name=marcosalvato
>re
>.zappatore
><http://cosmos.lab.fi-ware.org:50070/webhdfs/v1/tmp?user.name=marcosalvato
>re
>.zappatore&op=GETFILESTATUS> &op=GETFILESTATUS"
>
>
>
>from the following hosts:
>
>1.       cosmos.lab.fi-ware.org (the same host, public IP: 130.206.80.46).
>It works.
>
>2.       a FI-LAB machine (associated IP: 193.205.211.99) . It doesn’t
>work.
>
>3.       An non FI-LAB machine (my PC). It doesn’t work.
>
>
>
>According to the documentation, host 2 should works, while type 3 host
>should not. So the only undesiderable case is the second one and require
>to
>be fixed.
>
>
>
>The test results don’t change if I replace the hostname
>cosmos.lab.fi-ware.org with the resolved IP, 130.206.80.46; so this is not
>an issue caused by a non resolved hostname by DNS.
>
>
>
>Conversely, port 50070 seems to be closed at the hosts 2 and 3 (test
>executed via telnet).
>
>
>
>Thank you in advance.
>
>Best regards.
>
>
>
>Sergio.
>
>-----Messaggio originale-----
>Da: FRANCISCO ROMERO BUENO [mailto:francisco.romerobueno at telefonica.com]
>Inviato: venerdì 7 agosto 2015 09:52
>A: fiware-tech-help at lists.fi-ware.org
>Cc: sergio.delorenzis at albaproject.it
>Oggetto: Re: [FI-WARE-JIRA] (HELP-3762) [Fiware-tech-help] FIWARE Lab
>Assistance
>
>
>
>Hi Sergio,
>
>
>
>Can you give us more details regarding the operation you are trying to
>perform? I mean, is it a problem with WebHDFS REST API? Is it a problem
>with
>Cygnus?
>
>
>
>Best regards,
>
>Francisco
>
>
>
>
>
>El 7/8/15 9:50, "Miguel Carrillo (JIRA)" <
><mailto:jira-help-desk at fi-ware.org> jira-help-desk at fi-ware.org>
>
>escribió:
>
>
>
>
>
>https://jira.fiware.org/browse/HELP-3762?page=com.atlassian.jira.plugin
>
>
>
>
>
>
>
>
>
>
>
>
>
>https://jira.fiware.org/browse/HELP-3762
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>mailto:sergio.delorenzis at albaproject.it>
>
>sergio.delorenzis at albaproject.it
>
>
>
>
>
>
>Fiware-tech-help at lists.fi-ware.org
>
>https://lists.fi-ware.org/listinfo/fiware-tech-help
>
>
>sergio.delorenzis at albaproject.it>]
>
>
>
>
>
>
>
>
>
>
>
>________________________________
>
>
>
>Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario,
>puede contener información privilegiada o confidencial y es para uso
>exclusivo de la persona o entidad de destino. Si no es usted. el
>destinatario indicado, queda notificado de que la lectura, utilización,
>divulgación y/o copia sin autorización puede estar prohibida en virtud de
>la
>legislación vigente. Si ha recibido este mensaje por error, le rogamos que
>nos lo comunique inmediatamente por esta misma vía y proceda a su
>destrucción.
>
>
>
>The information contained in this transmission is privileged and
>confidential information intended only for the use of the individual or
>entity named above. If the reader of this message is not the intended
>recipient, you are hereby notified that any dissemination, distribution or
>copying of this communication is strictly prohibited. If you have received
>this transmission in error, do not read it. Please immediately reply to
>the
>sender that you have received this communication in error and then delete
>it.
>
>
>
>Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário,
>pode conter informação privilegiada ou confidencial e é para uso exclusivo
>da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário
>indicado, fica notificado de que a leitura, utilização, divulgação e/ou
>cópia sem autorização pode estar proibida em virtude da legislação
>vigente.
>Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique
>imediatamente por esta mesma via e proceda a sua destruição
>
>
>_______________________________________________
>Fiware-tech-help mailing list
>Fiware-tech-help at lists.fi-ware.org
>https://lists.fi-ware.org/listinfo/fiware-tech-help
>
>
>> FIWARE.Request.Lab.Data.BigData-Analysis.UnsuccessfullDataSaving
>> ----------------------------------------------------------------
>>
>>                 Key: HELP-3762
>>                 URL: https://jira.fiware.org/browse/HELP-3762
>>             Project: Help-Desk
>>          Issue Type: extRequest
>>            Reporter: FW External User
>>            Assignee: Francisco Romero
>>         Attachments: image002.jpg, image.jpeg
>>
>>
>> Hello,
>> in order to use the Cosmos's shared instance (username
>> marcosalvatore.zappatore), we tried to save data into Hadoop File
>>System,
>> but unsuccessfully.
>> Maybe a firewall is blocking us?
>>
>> Thank you in advance.
>>
>>
>>
>> Sergio De Lorenzis
>>
>> Alba Project s.r.l.
>> Via Don Luigi Sturzo, 36 - 73100 - Lecce (LE)
>> Tel.:  +39 349 15 48 139
>> Email:  <mailto:sergio.delorenzis at albaproject.it>
>> sergio.delorenzis at albaproject.it
>> Skype: sergio.delorenzis
>>
>>
>> _______________________________________________
>> Fiware-tech-help mailing list
>> Fiware-tech-help at lists.fi-ware.org
>> https://lists.fi-ware.org/listinfo/fiware-tech-help
>> [Created via e-mail received from: Sergio De Lorenzis
>><sergio.delorenzis at albaproject.it>]
>
>
>
>--
>This message was sent by Atlassian JIRA
>(v6.4.1#64016)


________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição


More information about the Fiware-tech-help mailing list

You can get more information about our cookies and privacy policies clicking on the following links: Privacy policy   Cookies policy