Skip to main content

Duplicates ~ Non Duplicates ~ Unique Records

Hello Group Members,
 
Let us look at simple methods to identify Duplicates, Non - Duplicates and Unique Records with an example in the post today.
 
Say you have a data file in IDEA with the fields TXN REF NO, CENTRE, DATE and AMOUNT.
 
The sample entry view looks like below ~
 
TXN REF NO, CENTRE, DATE, AMOUNT
1, DEL, 15.01.19, 500
2, MUM, 20.01.19, 750
3, PNQ, 25.01.19, 625
1, DEL, 15.01.19, 500
4, KOL, 30.01.19, 235
 
Now if your requirement is to identify duplicates from the above view based on TXN REF NO, CENTRE, DATE and AMOUNT it can be achieved using Duplicate Key Detection - Output Duplicates. The report will give you TXN REF NO - 1 with all Fields by side.
 
If your requirement is to identify Non-Duplicates on TXN REF NO, CENTRE, DATE and AMOUNT viz TXN REF NO - 2, 3 and 4 it can be done by using Duplicate Key Detection - Output Non Duplicates. 
 
Finally if you wish to receive all Unique Records on Fields TXN REF NO, CENTRE, DATE and AMOUNT where even the duplicate TXN REF NO - 1 appears (albeit only one of the duplicate entries) along with 2, 3 and 4 then this can be done using Summarization with Fields to Summarize being TXN REF NO, CENTRE, DATE and AMOUNT
 
Best Regards
 
Group Admin Team