topic Re: Removing duplicates problem in SAS Programming

Removing duplicates problem

ambadi007 — Thu, 15 Jun 2017 16:14:29 GMT

I have a data set and it contains Claim sfx and amount , I need to remove the duplicates claim , but the problem here is there could be different sfx in the same claim , if its different for the same claim then I need to keep that claim

Claim sfx amount

100 23 897

101 25 789

101 89 463 Need to keep this Claim because of different sfx

102 56 789

102 56 789 Need to delete this becase of same sfx

Re: Removing duplicates problem

Astounding — Thu, 15 Jun 2017 16:18:33 GMT

SAS can do this fairly easily:

proc sort data=have nodupkey;

by claim sfx;

run;

However, you should also consider what is the right outcome when CLAIM is the same, SFX is the same, but AMOUNT changes. perhaps you should go with:

proc sort data=have nodupkey;

by claim sfx amount;

run;

Re: Removing duplicates problem

Ksharp — Fri, 16 Jun 2017 13:39:24 GMT

data have;
input Claim     sfx          amount   ;
cards; 
100         23           897        
100         23           897        
101         25           789        
101         89           463     
102         56           789        
102         56           789
;
run;
proc sql;
create table want as
select *
 from have 
  group by claim
   having count(distinct sfx) ne 1;
quit;