BookmarkSubscribeRSS Feed
Shakti_Sourav
Quartz | Level 8

Dear Team,

I have created a data job which is under process job to identifying duplicate records.

I want to validate the data rows flag wise means which batch rows matched with Golden Flag.

 

I have attached screenshots for your references.

Shakti_Sourav_0-1663062891758.png

 

My data is like this,

 

Shakti_Sourav_1-1663062924963.png

 

Note:  I have tried by Cluster Number, I want it like if cluster number count is repeated or having count >1.

 

Ex: Want data:

ID          Name    Marks     Flag              Matchcode     Cluster Number  Cond_1

10 SHAKTI 68 GOLDEN 423~$$$$$$$$$$$$$$$$ 2 True
3 SHAKTI 33 BATCH 423~$$$$$$$$$$$$$$$$ 2 True
9 RAJESH 43 GOLDEN YF42$$$$$$$$$$$$$$$$ 4 True
5 RAJESH 6 BATCH YF42$$$$$$$$$$$$$$$$ 4 True
6 AMIT 77 GOLDEN &B~$$$$$$$$$$$$$$$$$ 5 True
7 AMIT 45 BATCH &B~$$$$$$$$$$$$$$$$$ 5 True

 

want only Batch flag which is False, and if batch flag is true then will come similar duplicate data from Golden Flag.

 

Please let me know if required any further details

 

 

Thank You 

Shakti

 

1 REPLY 1
audrey
SAS Employee

Hi,

 

Have you tried to use the Surviving Record Identification node?
It's meant to keep only one record per cluster, based on some conditions. 

 

Hope this helps.

www.sas.comsupport.sas.com
SAS®... THE POWER TO KNOW®

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 462 views
  • 0 likes
  • 2 in conversation