cancel
Showing results for 
Search instead for 
Did you mean: 

How to process huge files..error "Request Entity too Large Error "..!!

Former Member
0 Kudos

Hi ,

I'm processing a CSV file which is 30MB... after converting into XML , it is failing in SXMB_MONI with error ""Request Entity too Large Error " .

We are trying to increase the size of the "MaxRequestHeadersLength" as someone suggested in the below thread.

Intially it has 16,480.. I increased to 25,000 , still it is failing..

ANy suggestion how much I need to increase in this setting to handle around 30MB files? which after converting into XML.. it has size of around 200 to 250MB .

Or is there any other way I can handle this error?

Thanks

Deepthi

Accepted Solutions (1)

Accepted Solutions (1)

rajasekhar_reddy14
Active Contributor
0 Kudos

Hi,

When you working one ane scenario first you have to design what is the best approach..In your case you are trying to send 30mb file at a time,how you think that PI will work fine???

Try to split the file in to samller pieces,how you will do this is use java code to split the file,then try to send it.

Previously i had faced same situation,sending huge flat file ,i had writen on Java Mapping to split the file.

try to use Recordset per message opetion in File Adapter,i hope it will work it out.

Regards,

Raj

Former Member
0 Kudos

Thanks guys for your replies.

After going through your answers, I decided togo for splitting the file before mapping and appending the whole data at the receiver file adapter.

Hi Raj,

>> Previously i had faced same situation,sending huge flat file ,i had writen on Java Mapping to split the file.

>> try to use Recordset per message opetion in File Adapter,i hope it will work it out.

If possible, Please expand this one step by step . ANy reference blog will be helpful

Thanks

Deepthi

former_member200962
Active Contributor
0 Kudos
After going through your answers, I decided togo for splitting the file before mapping and 
appending the whole data at the 
receiver file adapter. 

Check this blog: /people/sravya.talanki2/blog/2005/11/29/night-mare-processing-huge-files-in-sap-xi

Actually a bunchful of methods are given here...inlcuding the above one:

Regards,

Abhishek.

Former Member
0 Kudos

Hi ,

Can someone please explain how to split the file in FCC.

ACcording to the below blog, they suggested to use Recordspermessage in file adapter. But it is not working for me.

http://www.sdn.sap.com/irj/scn/weblogs;jsessionid=(J2EE3417500)ID1646720650DB11224180977175880590End...

Is there anything I need to do apart from that "Recordspermessage" parameter?

Thanks

Deepthi.

Edited by: deepthi reddy on Sep 18, 2009 7:38 AM

former_member187339
Active Contributor
0 Kudos

HiDeepthi,

Please provide the source structure, It should be of this format for recordsetpermessage to work


<documentName>...
   <recordset>
<NameA>
<field-nameA1>field-value</field-nameA1>
<field-nameA2>field-value</field-nameA2>
<field-nameA3>field-value</field-nameA3>
</NameA>
<NameB>
<field-nameB1>column-value</field-nameB1>
<field-nameB2>column-value</field-nameB2>
<field-nameB3>column-value</field-nameB3>
</NameB>
   </recordset>
   ...
   <recordset>
...
   </recordset>
</documentName>...

Also check this url http://help.sap.com/saphelp_nw04/helpdata/en/2c/181077dd7d6b4ea6a8029b20bf7e55/content.htm

Regards

Suraj

Answers (3)

Answers (3)

Former Member
0 Kudos

A slight change in the mapping and "Recordset per message" operation in File Adapter helped the problem.

Thanks guys for your help.

former_member200962
Active Contributor
0 Kudos

Check the solution references given here:

Regards,

Abhishek.

Former Member
0 Kudos

Hi,

It also depends upon the hradware configurations you are using and compatibility of high volume data. So usage of "MaxRequestHeadersLength" is not only sufficient but also look for other alternatives such as split the files in samller chunks, try setting up try parameter EO_MSG_SIZE_LIMIT in SXMB_ADM etc.

Refer - section 3.2.9

https://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/2016a0b1-1780-2b10-97bd-be3ac622...

Hardware config such as ( Java Heap etc ) to make sure that XI can handle this file ( not recommended though). SAP recommends a size of 5 MBas the optimum size.

https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/72e2bb90-0301-0010-e883-c39...

/people/pooja.pandey/blog/2005/10/17/number-formatting-to-handle-large-numbers

https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/99593f86-0601-0010-059d-d2dd39dc...

Thanks

Swarup