topic Re: Deduplicate dataset in SAS Programming

Deduplicate dataset

Angel_Saenz — Tue, 15 Nov 2016 22:39:46 GMT

How can i deduplicate a dataset by ID1 and ID2, if I have the next structure:

ID1 ID2 DATE VALUE

1000 10 31JAN2016 5

1000 10 26FEB2016 6

1000 10 31MAR2016 7

The result that I expectedis:

ID1 ID2 DATE VALUE

1000 10 31MAR2016 7

(Which is the most current date according to the date)

Re: Deduplicate dataset

Reeza — Tue, 15 Nov 2016 22:42:37 GMT

Use proc sort.

proc sort data=have;

by id id2 date; run;

data want;

set have;

by id id2;

if last.id2;

run;

Re: Deduplicate dataset

Angel_Saenz — Tue, 15 Nov 2016 23:51:39 GMT

Thank you it works very good just a question in:
if last.id2;
why var id2? Can be any variable?

Re: Deduplicate dataset

Reeza — Tue, 15 Nov 2016 23:55:39 GMT

No, it has to be a variable listed in the BY statement.

And it picks the last of that group, based on your specifications, this is what was required, but you can modify it to fit your needs, if you have more variables or something.

You can review the documentation on how BY groups are processed and the FIRST/LAST variables and how they're calculated.

I find the examples and illustrations here helpful:

http://support.sas.com/documentation/cdl/en/lrcon/68089/HTML/default/viewer.htm#p0xu93fy5eemkyn1p6mj5elses7j.htm