Column store error - temporary table exceeds limitation of 2billion records

[Former Member]

Hello,

We are doing run time calculation with more than 2Billion records by using temporary tables, we are storing data in temporary table for further calculation within the procedure.  But the same throws "column store error" because of exceeding maximum table limitation in temporary table after the hana procedure executes for more than 1.30 hrs.

Is there any better way of handling the situation and optimizing the performance of procedure?  Kindly suggest.

Thanks in advance.

Regards,

Antony Jerald.

[lbreddemann]

I'd argue that you are probably doing things the wrong way if you manually create intermediate tables with several billion entries.

Anyhow, as of now (SAP HANA up to SPS 11) the maximum number of records per partition of a column store table is 2 billion.

So, you either have to use a row store temporary table (which probably will use way too much memory then), you change your procedure to allow for processing without the temp. table or: you batch your processing.

As you haven't explained what the procedure does in detail, it's not possible to provide detailed instructions on how to fix it, so that's as far as I can advise right now.