Help using Base SAS procedures

Remove duplicates with condition

Accepted Solution Solved
Reply
Frequent Contributor
Posts: 120
Accepted Solution

Remove duplicates with condition

Hi Team,

 

I need to delete the duplicate IDs with certain conditions from following dataset.

 

Data R;
input Id sal flag;
cards;
1 100 1
1 100 0
2 200 0
2 200 1
3 300 0
4 400 0
4 500 0
;
Run;

 

1. ID should be unique

2. If flag has '1' / '0' on same ID then need to keep the row with '1'

3. If flag has only '0' on ID then need to keep that row

4. If flag has multiple '0' with respect to same ID then need to keep any one or SAL is different then any

 

The output could be : 

1 100 1

2 200 1

3 300 0

4 400 0

 

Looking for kind support.

 

Regards,

Uma Shanker Saini


Accepted Solutions
Solution
‎08-25-2017 03:43 AM
PROC Star
Posts: 1,803

Re: Remove duplicates with condition

Posted in reply to umashankersaini

Try this:

 

 

proc sql;

create table want as

select *

from r

group by id

having sal=max(sal) and flag=max(flag);

quit;

View solution in original post


All Replies
PROC Star
Posts: 1,803

Re: Remove duplicates with condition

Posted in reply to umashankersaini

Data R;

input Id sal flag;

cards;

1 100 1

1 100 0

2 200 0

2 200 1

3 300 0

4 400 0

4 500 0

;

Run;

 

proc sort data=r out=temp;

by id sal descending flag;

run;

 

data want;

set temp;

by id sal;

if first.id and first.sal;

run;

 

 

 

Frequent Contributor
Posts: 120

Re: Remove duplicates with condition

Posted in reply to novinosrin

Hi Novin,

 

Thanks for your quick help and code works perfectly fine as per requirement.

 

It would be greatful if we can use it via proc sql because i need to implement it into approx 40 million obs and trying for SAS DI.

 

Regards,

Uma Shanker Saini

Solution
‎08-25-2017 03:43 AM
PROC Star
Posts: 1,803

Re: Remove duplicates with condition

Posted in reply to umashankersaini

Try this:

 

 

proc sql;

create table want as

select *

from r

group by id

having sal=max(sal) and flag=max(flag);

quit;

☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 3 replies
  • 758 views
  • 1 like
  • 2 in conversation