Split Files from sender and Receiver

[former_member229310]

Hello Gurus,  I have couple of questions on File adapters.  Sender CC:  1) How can i break the large file say 50 MB into 5 files of 10 MB ?  There is no Content Conversion so we cannot break in Recordset Per message.   2) Is it possible to break on size than number of recordset per message.  Receiver CC:  1) How can i generate 5 different files of size 10 MB each ?    Also is there any confirmation that can notify that the file is delivered successfully.  Thanks in advance.

[rajasekhar_reddy14]

No Content conversion then you Record set per message option will not works. What is yoru systems version?

[anupam_ghosh2]

Hi Jari,

Sender cc

1) How can i break the large file say 50 MB into 5 files of 10 MB ?  There is no Content Conversion so we cannot break in Recordset Per message. 

ans) Depends on what kind of file you are processing. Is it binary file,text file or xml file ? Since you have not mentioned anything then I assume its text file. Then the answer is use scripts to split the file.  Is it file to file pass through scenario or there is any mapping involved in any phase.

The script can be scheduled by administrator to run at specific times. The script after splitting  the files will move them to different folder from where PI picks it up.

2) Is it possible to break on size than number of recordset per message. 

ans) Instead of splitting file on basis of size would suggest to split on basis of number of lines each file after split will contain. Thus for example  if original file contains 100 lines you need to ensure that 10 files are formed with max 10 complete lines in it. If you split on basis of size then you are never sure that all of the files formed after split contains complete lines. Again  you need to be careful about naming convention of the split files. So that sender cc can pick them up sequentially.

In receiver side you can use similar approach to split the files using script.

About confirmation do you need emails or files?

You check this blog http://scn.sap.com/community/pi-and-soa-middleware/blog/2006/06/22/xi-playing-with-the-file-adapters...

About scripts to split files you can check this

http://wiki.sdn.sap.com/wiki/display/XI/Optimum+File+Size+for+various+file+scenarios+in+PI++part-2

Regards

Anupam

[Former Member]

Is there anyway to achieve the same requirement in PI 7.0?

[former_member312864]

Hi,

You can achive this through File Chunking it is only possible in case of EOIO(Quality Of Services).

You can go through following link for help

http://scn.sap.com/community/pi-and-soa-middleware/blog/2010/10/18/pixi-pi-73-processing-of-large-fi...

Regards,

Sarojkanta

[markangelo_dihiansan]

Hello,

Maybe this blog would help

http://scn.sap.com/community/pi-and-soa-middleware/blog/2011/12/26/fileftp-adapter--large-file-trans...

But it is only for file-to-file transfers.

Hope this helps,

Mark