join transformations possible at sender, receiver CC? similar to ETL tool

[Former Member]

There are two shipment history files (distributor sale, direct sale) with different field formats. Will it be possible to join files and update SAP BW?

csv file 1 (distributor sale) , 10 fields

csv file 2 (direct sale) , 5 fields

{Join file1, file2}->Integration Server->post the document into SAP BW.

File 1 and File 2 has enough volume, say 50,000 recs per day.

The first option that I know is:

-write a perl to join files and invoke perl from command line in Sender CC.

Seeking your help on better approach.

Please fwd how to invoke perl from command line. (Assume perl script is in windows server not part of XI app but visible to the same network. Can I use FTP server and invoke perl script?)

[Former Member · Accepted solution]

If the records are 50,000 recs per day i suggest you to avoid the use of BPM, for more reasons:

1) slow performances

2) difficulty to debug the Integration Process in case or error or problems

Technically it's possible to execute "Run Operating System Command Before Message Processing" like described

<a href="http://help.sap.com/saphelp_nw2004s/helpdata/en/e3/94007075cae04f930cc4c034e411e1/frameset.htm">Configuring the Sender File/FTP Adapter</a> and for sure this will be a very performant way.

Regards,

Sandro

[Former Member]

XI has adv. when compared to just ETL. It is possible in BPM, I will revisit this when the requirements are firm.

[moorthy]

Hi,

One option: Using BPM

1) Pick 2 files separately by 2 message interfaces so 2 communication channels.

And in the bpm, merge these 2 files into one message and send to BW.

There is a bpm Pattern available in the SAP BASIS software component in the repository-

http://help.sap.com/saphelp_nw2004s/helpdata/en/0e/56373f7853494fe10000000a114084/content.htm

Second option , may be using Client Java Proxy and upload the file as single data.

In both first option is straight forward and you can try out this.

Hope this helps,

Rgds,

Moothy

[Former Member]

Hi,

If there are two files in to be merged then there is no other go then to use BPM and this is going to reduce performance.

I guess the first would be to dot he feasibility study.

Or merge them outside SAP XI . But then why dou u need XI for???

Regards

Vijaya

[Former Member]

Sandro, Satish

I want to keep the join in XI without using custom script as much possible.

Let me know it that is possible.

[Former Member]

Ravi,

My suggestion would be write two interfaces where the first interface would invoke the command and executes it.

Then the second interface would pick this file and sends to BW.

---Satish