Handling Large amount data is PI is it feasible

[Former Member]

Hi experts,

i have a scenario SOAP-PI-IDOC where in i need to handle a large amount data consisting of 50k records, each record having almost 5-6 fields.

My Queries

1. Will PI be able to handle large amount data, is it feasible??

2. Can we have a alternate solution as to split records, making multiple interface calls

i am working in PI7.31 dual stack, the best in class hardware supported for the mentioned version.

Need some light on this.

Regards,

Sushant

[Former Member · Accepted solution]

Hi,

It should be fine. Make sure that your system is prepared correctly. That the memory is handled well.

SOAP Web Service - They also call it the "BIG" Web Service so it is there to handle the bigger payloads.

RestFul web service is made for smaller payloads.

A few tips you can use to minimize the impact on your system.

1. Try and keep the mapping simple.

2. Set the IDoc to process as bulk(Packaging Required). This will make sure that the IDoc side is batch in bits and pieces.

3. Make sure that network line is stable.

But my guess is it will be fine.

Regards,

Jannus Botha

[iaki_vila]

Hi Sushant,

I have worked with scenarios with payloads between 5 to 80 MB, the main problem i 've had is the PI memory. You should check the number of instances and the memory available, also SAP recommends to have a de-central adapter engine. Check this note 1502676 - Scaling up large PI installations

Regards.

[sendhil_kumar]

Hi Sushant,

Look at this blog, this talks about handling Bulk messages..

--

Sendhil