on 05-07-2013 12:18 AM
I know that Data Service is more about connecting to the social networks to extract, transform and load the data beside to this, it performs Text Analysis ...etc ...but after this those data will be saved on HANA In-Memory ...but why we need to work with SAP HANA Modeler, the data are already processed by Data Service?? .... i need this explanation somehow because I'm working on Sentiment Analysis using SAP HANA Sentiment Intelligence RDS.
thanks alot
Hi Mirella,
Data Services (DS) is an ETL (Extraction, Transformation and Loading) Tool, whereas the Modeler is the admin and Modeling tool. Modeler is used to create objects which can be used to Analyze the data stored in HANA.
Regarding Sentiment Analysis, you are right that you can extract the data from Social media networks using the DS with Map / Reduce framework like Hadoop and store it in HANA. While loading it to HANA, you can "process" the data so that it is cleansed and validated before getting stored.
What modeler helps you with, is to provide right structures so that the data can be Analyzed and reported properly. The structures provide efficient access patterns to the data. So you need the Modeler to access the stored data in HANA.
Hope this helps.
Regards,
Ravi
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Ravi,
Thank you very much , it was really helpful to understand what is the difference, but i need a help also in, regarding the extracting the data from Social Media like Facebook is somehow difficult, and they dont give more time for example Access Token, you can extend it only for 24 more hours. and What exactly i should click and which is important for what i need .. I'm really confused
Some of people made Crawler using Development Environment Ecplise, ain't HANA Studio ??
Crawler is jus to creat the accessbility between the HANA Database and the Facebook API??
but how to do it ? I don't know, that's my problem
Thank you very much
Hi Mirella,
I am not experienced on Hadoop HANA integration, but based on what I know, you can capture the Social media data (like Facebook) using Hadoop, which can later be integrated with HANA using Data Services.
You can search for Hadoop HANA integration and may find some of the links like:
http://scn.sap.com/thread/3327423
http://scn.sap.com/docs/DOC-34406
I am also aware that some IT services companies have developed framework on Hadoop which can provide connectors to other systems. You can google for such services and may find additional information.
Regards,
Ravi
Mirella ,
SAP has integrated HANA with Hadoop, enabling customers to move data between Hive and Hadoop's Distributed File System and SAP HANA or SAP Sybase IQ server.
Configuration Steps...
http://wiki.sdn.sap.com/wiki/display/EIM/Configuring+Data+Services+and+Hadoop
Few Useful URL below.
http://scn.sap.com/community/hana-in-memory/blog/2013/04/30/big-data-technologies-applications
HANA Hadoop integration.
http://www.saphana.com/docs/DOC-2934
SAP HANA and hadoop integration scenario.
http://hanahadoop.testdrivesap.com:8000/sap.guestbook/bigDataDemo.html
Soon I will be publishing my blogs on SAP HANA Hadoop integration.
Hope it helps ,
Regards,
Mahesh
Message was edited by: Mahesh Kumar CV
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Mahesh,
I thank you very much,
but is it possbile to find something where i could easy connect facebook to hana db to load data for further processes by businessobjects Data service ...
for connecting and loading data from facebook or twitter on HANA DB using such like Restfb ??
i have tried to find it but only what i have found is connecting Rest for Business Intelligence Plattform SDKs http://wiki.sdn.sap.com/wiki/display/BOBJ/Business+Intelligence
i need one with HANA to store the data
Regards,
Mirella
In addition to above points:
BODS 4.1 is required to access HADOOP as a data source.
The HANA modeller, can access only SLT and flat files as data source to control inbound flow of data into SAP HANA. If you need to pull data from other external databases or BW or ECC , you will need to use BODS to configure an ETL ( extract transform and load) into HANA.
Hope this helps!
Regards,
Rama
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Mirella
You may want to find out about HANA text analysis.
http://scn.sap.com/community/developer-center/hana/blog/2013/01/03/sap-hana-text-analysis
After you have extracted the data and have them in HANA, you can extract entities and do complex text search on them.
Dennis
Hi Dennis,
I'm already finished with getting the data from Facebook using eclipse java development, and now having data in json format ,before I begin with text analysis, i have to extract the data transform and load on the HANA. There is specific way or tool I could use to do it ??? Or you think the best way which is data service designer ? Which adapter I should use, because DS doesn't understand json format, so it should be change to XML ...etc
What do you suggest me to do?
I'm fully listened
Thanks alot ,
Mirella
User | Count |
---|---|
87 | |
10 | |
10 | |
10 | |
7 | |
6 | |
6 | |
5 | |
5 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.