cancel
Showing results for 
Search instead for 
Did you mean: 

How to import large CSV files in HANA Web-based Development Workbench?

Former Member
0 Kudos

Hi,

I am a student and I want to write a project paper about SAP HANA.

To compare row store and column store I need some larger tables in HANA.

So far I have managed to get a HANA MDC trial instance.

I can execute SQL-commands with SAP HANA Web-based Development Workbench

Now I want to import some larger CSV files (some 100MB), so I can use

  IMPORT DATA INTO TABLE "MYTABLE" FROM '/data/data.csv'

to fill my tables.

But how can I upload my csv-files? And what would the file path be?

Are there other ways to import large datasets to the HANA trial instance on HANA Cloud Platform?

Thanks and best regards,

Oliver

Accepted Solutions (0)

Answers (3)

Answers (3)

0 Kudos

Hi Oliver,

I faced almost the same issue. In my case the upload via HANA Studio for huge csv-files was too time intensive and have ended with errors. As workaround I developed lightweight java programm, which uses jdbc library. The using of the programm reduced upload time by ca.3 times.

Best regards,

Dimitri

Former Member
0 Kudos

To resolve this issue please do as follow:

As a workaround, convert the large XLS/XLSX files into CSV format, to load them into HANA tables. There are no size limitations for CSV files.

Convert the XLS/XLSX files to CSV files using the Option in MS Excel.

File   > Save As   > Save as Type   > CSV(MS-DOS)

for more click here http://www.stechies.com/hana-studio-not-responding-when-uploading-large-excel-files/

Former Member
0 Kudos

Hi Arpita Rastogi,

thank you for your response.

But I was not talking about Excel files.

I already have a large CSV file.

But now I'd like to import my data using a SQL command.

Best regards,

Oliver

chandan_praharaj
Contributor
0 Kudos

Why cant you try with direct import from HANA studio.

File --> Import --> Data from Local file

Former Member
0 Kudos

I could not find a way to download HANA Studio.

But I installed the HANA extension for Eclipse and I already imported my data this way.

But this is very ,very slow, and maybe after 20 minutes you get an import error, and you have to find out the problem and then try again, quite annoying.

I'd like to import even larger datasets and may be I import several times.

If SAP is promoting HANA for processing huge data sets, they should give a really easy way to import large amounts of data within the testing environment.

Ideally a new trial instance of HANA should already contain some sample tables with millions of rows to play around with (as an option when creating the instance).