How to Segregate Duplicate Records, Contained in Single, External "PC" File
Please, might someone have any ideas ?
My objective is to segregate duplicate records, contained in a single, external, input PC file. (The 100 byte record contains approximately 14 fields, of which 3 or 4 fields will be used to determine duplicate records). This external, input PC file is read into the BW warehouse v4s/Bi 7.0.
Since duplicate records may indicate fraud or criminal behaviour, I want to segregate duplicate records (contained in the external, input PC file), for the purpose of generating management reports.
Subject to any of your ideas to identify and segregate duplicate records, I plan to model a conventional data flow.
Ext. File  PSA  DSO  Infocube.
I appreciate any help.