Merge multiple input files into one output file

[neilpadilla]

Hi Guys,

We are currently updating a pass-through interface. This interface is using an ICO flow.
Currently, the interface only processes 1 text file -> 1 text file through FTP adapter from ECC server to target FTP server.

Due to a performance issue encountered in ECC, a modification is needed to be done on how the files are generated in ECC.
The text file generated in ECC will be divided into 5 batches (5 different text files) to avoid the issue.

Now that file will be divided, a changes in PI is needed to be applied.
In PI, these 5 files will be picked up from the ECC server.
These files are needed to be merged/combined and be outputed into 1 text file.

These batches of file should be complete in the server before PI will pick-up/send it to the target system.
Is there a possibility to validate that these group of files are already complete in server?

To be scenario: 5 text files -> 1 text file

Currently, we don't have a mapping or any ESR object. We only have the ID objects.

My concern is, how can this be done in PI?

I have read several blogs using the ccBPM, although I have never used this procedure. So I also need to study this.
Also, are there any procedure that can be done aside from ccBPM?

System Details:
     PI 7.30

     SP 11

Regards,
Neil

[azharshaikh]

Hello Neil,

You can write the file at Receiver Channel in Append mode. However you need to have some base line for this.

How many set of 5 Files will be placed in Input directory on per day basis? If you will get only 5 files per day then you can write the file in Receiver File in Append mode (on per day basis)

Regards,

Azhar

[former_member184720]

I don't think it is N:1 interface.

It's a pass through scenario and you just want to merge the files.

Your sender channel :

pick all the files -> inputfile.*txt

Use modification check option under advanced mode which ensures that files are being picked from source directory only when it's completely written

Refer to question no 2 here -

Sender File Adapter Frequently Asked Questions - Process Integration - SCN Wiki

Receiver channel :

Use File construction mode - append mode to merge the files.

Doesn't it work for you?

[pvishnuvardan_reddy]

Hi Neil,

N:1 is possible only with BPM.

I am afraid we cannot achieve this with out BPM.

Regards

Vishnu