How much volume of data (Flat file) XI 3.0 can handle?

[santosh_k3]

Hi Experts,

I am using XI 3.0 system,

my scenario is (BW)File->XI--->File(Third Party)

So there is a huge amount data, it has about more than 500MB file.

what would be the best size , if we divide the file into chunks and process them in XI 3.0?

can i divide into 50MB files a each and then process it?

can any one suggest me what would be be the best size to divide it into multiple files.

from the performance point of view.

Thanks

Sai

[naveen_chichili · Accepted solution]

Hi Sai,

>>>what would be the best size , if we divide the file into chunks and process them in XI 3.0?

It purely depends on the server performance and how the server is tuned with the require parameter values

>>>can i divide into 50MB files a each and then process it?

yes..you would be able to process if your server is well tuned.....better you divide into bit less chunks so that you need not worry .....

Regards,

Naveen

[santosh_k3 · Accepted solution]

Hi chichilin ,

thanks for u r reply,

Can i make it into 20MB size of each file?

>>depends on the server performance

How can i know the server configuration

do i need to ask basis people regarding this.

Thanks

Sai

[naveen_chichili · Accepted solution]

SAI,

yesss....You need to check the tuning parameters with your basis team..

Check below parameters:

u2022 UME Parameters : May be we need to look into the pool size and poolmax wait parameters - UME recommended parameters (like: poolmaxsize=50, poolmaxwait=60000)

u2022 Tuning Parameters: May be we need to look/define the Message Size Limit u201Clike: EO_MSG_SIZE_LIMIT = 0000100u201D under tuning category

u2022 ICM Parameters: May be we need to consider ICM parameters (ex: icm/conn_timeout = 900000. icm/HTTP/max_request_size_KB = 2097152)

if this is the case you would be able to process 20 MB file easily

Regards,

Naveen

[Former Member · Accepted solution]

I agree with Chichilin.

Make sure that XI Heap Memory Size is bigger than 20Mb

[Former Member · Accepted solution]

Hi Sai

SAP PI Best practices suggest that in general you have better performances if message size is between 1MB and 5MB.

However it depends on hardware and system configuration.

Check this link:

http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/2016a0b1-1780-2b10-97bd-be3ac62214c7

Regards,

Giuseppe

[Former Member]

Hi Sai,

Ref. this link for tunning parameters: http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/70ada5ef-0201-0010-1f8b-c935e444b...

http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/d0111fef-d311-2a10-c0b9-f33a49c1f...

Thanks,

[baskar_gopalakrishnan2]

SAP normally recommends file size for optimum performance is upto 5 MB. However performance also depends on the hardware configuration. If you are using flat file on the sender side, you can split the data into multiple chunks by specifying fcc parameter

Recordset per message = some small number

Also use chicillin tuning parmeters for handling optimum performance

Hope that helps.

[former_member854360]

It depends on Server performance. normally for best performance you can go with 4 to 8 mb

Please see this

[rajasekhar_reddy14]

There is no offical number from SAP on this,it is completely depending on your server configuration.

[Former Member]

If i don't say wrong, the maximum file size suggested by Sap on XI 3.0 is 100mb.

However, check this blogs. This may be helpful for you:

/people/sravya.talanki2/blog/2005/11/29/night-mare-processing-huge-files-in-sap-xi

/people/alessandro.guarneri/blog/2007/02/21/sap-xi-acting-as-a-huge-file-mover

Check also File Adapter: SAP Note 821267

If i remember correctly, Sap's suggested Technical limit is around 2Gb.