How to Segregate Duplicate Records, Contained in Single, External "PC" File

[Former Member]

Please, might someone have any ideas ?

My objective is to segregate duplicate records, contained in a single, external, input “PC” file. (The 100 byte record contains approximately 14 fields, of which 3 or 4 fields will be used to determine duplicate records). This external, input “PC” file is read into the BW warehouse v4s/Bi 7.0.

Since duplicate records may indicate fraud or criminal behaviour, I want to segregate duplicate records (contained in the external, input “PC” file), for the purpose of generating management reports.

Subject to any of your ideas to identify and segregate duplicate records, I plan to model a conventional data flow.

Ext. File  PSA  DSO  Infocube.

I appreciate any help.

Thank you.

craig.macfarlane@sap.com

[Former Member]

Hi,

do it in the startroutine of your transferrules with a DELETE ADJACENT DUPLICATES FROM ....COMPARING ....(your fields)

/manfred

[Former Member]

Load file data to PSA & use Error Handling option(Green,Reporting) & then load data to the target.