HANA and DataServices - delta merge during big load

[former_member191072]

Hi Gurus

I'll do load oracle table to HANA via DataServices. Main event is big 1 table.

At that time , I want to execute delta merge during load , like every 100000 records/every 3 mins etc.

I'm understand about perfoemance risk but ..... I have many times memory shortage problem which caused by forget execute of delta merge.

But It looks like no setting content about delta merge in Dataservices .... forcely , execute sql after load ?

I don't want to use subdivide big table and load it and execute merge table after every load method.

It's just my idea , execute 'MERGE DELTA OF BIGTABLE' every 3 minutes by cron or timer during load , Is it good method?

Rgds,

Jim

Message was edited by: Tom Flanagan

[former_member191072 · Accepted solution]

Hi ,

I split data and create many job for this load, delta merge worked fine .

(If no split this , memory will be punk by delta memory)

Bulk load is fast, but I hope little gentleness....

Thanks ALL!

[Former Member · Accepted solution]

what is the delta memory size?  maybe this is set to too high?

indexserver.ini -> mergedog -> max_delta_memsize

[lbreddemann]

Hi Jim

if your big table requires a merge, AUTOMERGE will pick it up. The mergedog process checks it every 60 seconds, so that should be alright for your requiremen.

If the table doesn't need to be merged, it won't.

Manually handling the delta merge is a fine-tuning action that is most often not required or recommendable.

- Lars

[former_member182302]

Hi Jim,

Have a look on this thread:

Regards,

Krishna Tangudu

[former_member191072]

Hi Krishna,

No, I'm using bulk load , from oracle table to hana table directly via DataServices.

I can't add commit or delta command during this bulk load . You want to say "no use bulk load" ?

Just I want to execute delta merge via XXXXX records or XXX min cyclically. Why don't exist this feature in HANA(DS?)....

Jim