cancel
Showing results for 
Search instead for 
Did you mean: 

how to process multiple idocs(huge data) to a single csv file in PI7.4

PS23
Participant
0 Kudos

Hi

Its slightly urgent,and so appreciate quick response.

We have idoc to file scenario wherein we r sending multiple idocs (Using "collect idoc") and generating single csv file out of it..Now there are more than 800 idocs generated with around 30,000 segments in one of the idocs and during processing using RSEout00 it gave memory dump..How can we acheive all idoc in one file. PI7.4, single stack is being used.PLs suggest.Thanks Pratibha

Accepted Solutions (0)

Answers (4)

Answers (4)

PS23
Participant
0 Kudos

HI Alll

Well memory issue cudnt be sorted but yes following workarounds was done:

1.Filter out segment form idoc which wasnt used in map, which reduced the size drastic

2. Two OM were used, 1st Om for idoc to target (legacy file) and 2nd for adding timestamp to the file.

3.Two ICO were used, 1st ICO to put file appended at one path and the other ICO had channels responsible for pulling the appended fioe and pushing it to legacy folder.

Thanks all for ur inputs

PS23
Participant
0 Kudos

Thanks guys..

workaround is that rseout sends idocs in chunks and these chunks are appended in PI.

PS23
Participant
0 Kudos

Hi All

Was looking for some workwround wherein i can consolidate all the chunks received in PI inorder to process them in single file along with timestamp.

Already tried options which did not work are;

1.dynamic configuration along with append at receiver file adapter (NFS)

2. Cardinality changed to unbounded than 0.to.1, inordEr to receive multiple chunks at one go, and idoc sender packaging option being checked along with collect idocs option checked AT R3 end.

3.Introducing temp folder and file channels inorder to collect idoc with simple append at one folder and final channel picking the all file (*already appended) and pushing it to final path wth generating timestamp in filename using variable substitution in channel.

Another question is how does collecting multiple idoc option in sender channel actually works in idoc to file scenario.

I really appreciate and need suggestions.

Thanks Eng Swee,

Increasing memory size seems slightly not feasible at this stage.

Many thanks

Pratibha

engswee
Active Contributor
0 Kudos

Hi Pratibha

The dump on RSEOUT00 would be on the sending ABAP system and nothing to do with the single stack PI system. You will need to get either or both an ABAP & Basis consultant to look into the memory dump issue, either to see if they can increase the memory.

Rgds

Eng Swee