File Splitting in XI.

[Former Member]

Hi,

My Scenario is As below...

[ Legacy ( file ) ] -

---

> [XI] -

---

> [ R3 ( Proxy ) ]

1. My File is having structure as single <ROW>... </ROw> occurance is 0..unbounded.

2. Now problem i am facing is if number of line items increase ...XI is unable to pick file properly.

3. I want to split file before XI.

or on XI server and make smaller files.

What could be the better solution?

Please Reply.

Regards,

Akshay.

[prateek · Accepted solution]

<i>3. I want to split file before XI.

or on XI server and make smaller files.</i>

Splitting the file before XI would considerably reduce the load on XI.

To split it in XI, u may use OS commands.

Some other approaches

/people/alessandro.guarneri/blog/2006/03/05/managing-bulky-flat-messages-with-sap-xi-tunneling-once-again--updated

/people/sravya.talanki2/blog/2005/11/29/night-mare-processing-huge-files-in-sap-xi

Regards,

Prateek

[henrique_pinto]

If the input files are flat files and not xml yet, you can use file adapter FCC with max num of records per file option. In this way, it will serialize the processing and the load <i>should</i> be lower.

Regards,

Henrique.

[Former Member]

>>>If the input files are flat files and not xml yet, you can use file adapter FCC with max num of records per file option. In this way, it will serialize the processing and the load should be lower.

Henrique, guess this is not going to work. We tried to play with this. But whole J2EE restarted when used this for a 75 MB file. I think it loads thewhole file into memory and sends only the number of recordset msentioned in the cc for each msg.

Pls correct if I am wrong.

Regards,

Jai Shankar

[Former Member]

>>> I want to split file before XI.

or on XI server and make smaller files.

Before XI processes the msg. Use shell scripts to achieve this.

Regards,

Jai Shankar

[Former Member]

hi jai,

can you please let me know more ion this

Akshay.

[Former Member]

Processing large files is really a pain. Some points to look for this.

1. Java heap size.

2. Amount of Content conversion

3. Usage of custom/std adapter modules

The best practise is to split the large file into smaller ones and process them.

No idea how to develop a script, but you can get a lot of examples in internet. Just do a quick google. You need a script that will split the larger file into smaller files. This script has to be scheduled at OS level (independent of XI). In XI give the path of smaller files.

Regards,

Jai Shankar

[Former Member]

What could be done at XI level.

Can i split files in XI and place them back on XI directory?