Remove duplicate records

mohamed

Forums

Hi,
I  have to remove duplicate rows from a database. It should keep first occurrence of the duplicated row in the result file. When I use duplicate key detection, it is removing all occurrence of the duplicates. Is there anyway to get unique records only  from a database?
Thanks,
Shafeer

mohamed Mon, 11/21/2016 - 06:26

Tried to achieve the above requirement with steps below.
I did a summarization of the input database. Then performed a Match only join between summary database and input database. This is giving the reult database as expected.

Brian Element Mon, 11/21/2016 - 07:23

Hi Shafeer, thanks for sharing your solution to that problem.  Another way might be to perform the summarization and adding all the additional fields to the summary selecting use from first occurance.

Brian

mohamed Wed, 11/23/2016 - 04:51

Hi Brian,
Found one issue in my approach. If there are more than one blank rows it will be excluded. So proceeded with adding additnoal rows as you suggested.
Thanks,
Shafeer