[Backlogmanager] [FIWARE-JIRA] (HELP-9268) [fiware-stackoverflow] Dump Twitter tweets from MongoDB to COSMOS

[Fernando Lopez (JIRA)]

     [ https://jira.fiware.org/browse/HELP-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fernando Lopez updated HELP-9268:
---------------------------------
     HD-Chapter: Data
    Description: 
Created question in FIWARE Q/A platform on 29-08-2015 at 16:08
{color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos


+Question:+
Dump Twitter tweets from MongoDB to COSMOS

+Description:+
I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job.

I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java.

Thanks


  was:

Created question in FIWARE Q/A platform on 29-08-2015 at 16:08
{color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos


+Question:+
Dump Twitter tweets from MongoDB to COSMOS

+Description:+
I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job.

I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java.

Thanks


     HD-Enabler: Cosmos

> [fiware-stackoverflow] Dump Twitter tweets from MongoDB to COSMOS
> -----------------------------------------------------------------
>
>                 Key: HELP-9268
>                 URL: https://jira.fiware.org/browse/HELP-9268
>             Project: Help-Desk
>          Issue Type: Monitor
>          Components: FIWARE-TECH-HELP
>            Reporter: Backlog Manager
>            Assignee: Francisco Romero
>              Labels: fiware, fiware-cosmos, hadoop, mongodb, python
>
> Created question in FIWARE Q/A platform on 29-08-2015 at 16:08
> {color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/32287272/dump-twitter-tweets-from-mongodb-to-cosmos
> +Question:+
> Dump Twitter tweets from MongoDB to COSMOS
> +Description:+
> I'm wondering what should be the best approach to dump a lot of tweets obtained from Twitter Streaming API into COSMOS in order to run a very simple MR job.
> I was thinking on converting the collection documents to CSV, one per line probably, and then scp those to COSMOS. But I'm not sure if I need HIVE to run MR job once there or I can run the job in a more manual way. I was thinking on using Python for this, I prefer not having to use Java.
> Thanks



--
This message was sent by Atlassian JIRA
(v6.4.1#64016)