Data Validating in Data management Studio

[Shakti_Sourav]

Dear Team,

I have created a data job which is under process job to identifying duplicate records.

I want to validate the data rows flag wise means which batch rows matched with Golden Flag.

I have attached screenshots for your references.

My data is like this,

Note:  I have tried by Cluster Number, I want it like if cluster number count is repeated or having count >1.

Ex: Want data:

ID          Name    Marks     Flag              Matchcode     Cluster Number  Cond_1

10	SHAKTI	68	GOLDEN	423~$$$$$$$$$$$$$$$$	2	True
3	SHAKTI	33	BATCH	423~$$$$$$$$$$$$$$$$	2	True
9	RAJESH	43	GOLDEN	YF42$$$$$$$$$$$$$$$$	4	True
5	RAJESH	6	BATCH	YF42$$$$$$$$$$$$$$$$	4	True
6	AMIT	77	GOLDEN	&B~$$$$$$$$$$$$$$$$$	5	True
7	AMIT	45	BATCH	&B~$$$$$$$$$$$$$$$$$	5	True

want only Batch flag which is False, and if batch flag is true then will come similar duplicate data from Golden Flag.

Please let me know if required any further details

Thank You 

Shakti

[audrey]

Hi,

Have you tried to use the Surviving Record Identification node?
It's meant to keep only one record per cluster, based on some conditions. 

Hope this helps.