Client proxy with huge data

[Former Member]

Dear All,

My scenario is proxy to jdbc is working perfectly with minimum data,

but when trying the huge data its gettnig failed at sap end .

Means there is one report which is calling the client proxy as background job which contains approx 3lack record.

and its getting failed in sxi_monitor with below error .

Error while receiving by HTTP (error code: 110 , error text: HTTPIO_PLG_CANCELED)

System_Error">HTTP-Client: exception during receive: HTTP_COMMUNICATION_FAILURE

  Failure because of too many retries!!!

what i suppose to do .

your help will be appreciated.

thanks and regards,

Anup Banerjee

[former_member181985]

what is the payload size for 3 lakh records?

[Former Member]

Dear all,

thanks for the reply,

payload size is 181 MB.

IF i will try to split message at sap end then they will have to call proxy class in loop approx 1000 times .

will it be good idea.. ?

thanks and regards,

Anup Banerjee

[former_member181985]

i believe 10 MB should be fine in each transaction. The problem i could see only with JDBC.

May be you can have this solution for JDBC

http://scn.sap.com/people/varun.mukund/blog/2010/03/25/fast-bulk-database-inserts-from-sap-pi

[Former Member]

Thanks for the reply,

I agreed with your point .

is the good idea to call proxy in loop at sender sap end .

thanks and regards,

Anup Banerjee

[former_member181985]

Yes it is the best practise.

[Former Member]

Hi,

Which version of PI u r using??

If ur version is >= PI7.11, then u can use ICO configurations (XI3.0 protocol) in addition to chunking messages.

Thanks

Amit Srivastava

[Former Member]

as per i believe when a proxy called by sender sap a new http session creates..

if sap team will call it in loop then wht about the http session..? They are assuming at least 1000 times it will call .

is it create new http session on each call. ?

thanks and regards,

Anup Banerjee

[former_member181985]

if it is 10 MB for each transaction then there will be only 19 transactions for 180+MB file

>>is it create new http session on each call. ?

obviously yes.

[Former Member]

I have suggested to sap team to split the internal table to number of internal table containing at most

10000 records in each internal table by loop and call the proxy in loop and also i am changing my configuration to ICO .

I thing 10000 record will successfully proceed.

Let see wht happens....

anyways thanks for your wonderful support..

thanks and regards,

Anup Banerjee

[former_member184681]

Hi,

Have a look at this thread, it provides a few useful links for your problem:

Regards,

Greg

[Former Member]

Hi,

In addition to Mark's suggestion, u can also think of splitting the data in multiple chunks from SAP end??

Thanks

Amit Srivastava

[markangelo_dihiansan]

Hello,

You can refer to this link: How To... Investigate Timeouts In Synchronous XI/PI Scenarios

https://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/c059d583-a551-2c10-e095-eb5d95e03747&overrid...

See Section 2.2.8 for the cause and 2.3.5 for a solution

Hope this helps,

Mark