Large XML files, how to split and read them in PI

[former_member216353]

Hi,

For a specific requirement, we have a 60 MB-90 MB XML file being generated by a legacy application.

This file has to be processed by PI 7.31 Sender File Adapter and should be posted as a ABAP proxy to SAP ECC system.

To address any performance issues, we are planning to read the files in chunks.

Is there a way by which we can configure the file adapter to pick a fixed no.of records to limit the size.

In inputs in this regard will be appreciated.

regards,

Younus

[Former Member]

Hi Younus,

First of all if you are using PI 7.31, then you should be quite able to process XML file of about 100MB scale. Performance issue shall occur in ECC side instead as it can not handle such high volume.

My suggestion will be to pick the whole XML file at one go and do necessary mapping. However on receiver side use SOAP Adapter instead of XI for making proxy calls to ECC.

In SOAP adapter (using HTTP as Transport and XI 3.0 as Message protocol) there's an option as 'XI Packaging' which can be used to send data in packets.

Refer below help doc on it.

Configuring the Receiver SOAP Adapter - Advanced Adapter Engine - SAP Library

Thanks

Bibek

[Muniyappan]

Hi,

if you can get the flat file you can think of using this.

Regards,

Muni.

[Former Member]

Hello,

U cannot use chunk mode feature in case of transformations.

BTW, what performance issues u are facing and exactly where in PI/ECC?

Thanks

Amit Srivastava

[Harish]

Hi Yunus,

Please refer the below blog

If you do need to tranform the file in PI (Mapping in PI) then i would suggest to pick the file and post to proxy without any chunk mode. PI should able to handel the 60-90 mb file.

regards,

Harish