Huge message size coming from ECC

[Former Member]

Hi Experts,

   We have a scenario where our sender is ECC and receiver is a third party system. ECC is connecting to PI through proxy. We are receiving a huge volume of data nearly around 500-700 MB from ECC. The message is taking more than 20 minutes to process the message from integration engine. Is it possible to process the message in few minutes like processing the message in around 1- 5 minutes.

Thanks in advance.

Thanks,

Srinivas.

[Former Member]

Hi Srinivas,

If you are on higher PI version move the scenario to ICo to process the message in AAE, you can have considerable improvement in processing time.

Define large message queue in SXMB_ADM to process this large msg in separate queue not to have impact on other message processing.

Regards,

Pranav

[Former Member]

Hello Srinivas,

You can try to use Integrated Configurations, in case you have not already used it. This would give in some reduction of time by local processing in AAE.

Thanks,

Sudhansu

[Former Member]

Hello Srinivas,

I think a good load of time will be consumed by the Simple Transformation, so renaming tags won't solve your problem. Better split the message. How does the receiver deal with this amount of data?

Regards,

Jörg

[Former Member]

Hi Srinivas

We have faced this problem in our project as well. If ECC sends 500-700 MB xml message, then PI will always takes that amount of time.

If possible, check in the ECC side and try to spilt that mesasge in multiple messages so that they can run in parallel and hence the time will be less.

Or else use a dedicated queue for this interface, so that other interfaces does not get afftected because of this interface.

[anupam_ghosh2]

Hi Srinivas,

                     How have you designed the scenario? Does it involve BPM? Are you using DOM parser in java mapping? BPM generally affects system performance. With the same payload which is causing the delay, please run the mapping in test tab. Is it taking same time or less? Complicated mapping logic might delay the processing. If you find in test tab the mapping is not taking that much time then you need to discuss the issue with BASIS team. There might be memory constraint in the server which needs to be eradicated.

Regards

Anupam

[iaki_vila]

Hi Srinas,

You can do several things:

1) Instead of using an abap proxy, you can generate a file, PI will only moves the file between the two ECCs, without ESR. With this approach you will need to work with files in the ECC. The ECC endpoint will need a job to look for files.

2) If it's possible to split the message, to send several messages from sender ECC.

Regards,

[anandvithal]

Hi Srinivas,

If you reduce the xml tag names to single alphabet for example

<firstname>Anand</firstname> to <f>Anand</f>

you can reduce the payload size and also its processing time in PI.

Thanks,

Anand