DATA Step, Macro, Functions and more

Removing dups in a data/set step

Accepted Solution Solved
Reply
Frequent Contributor
Posts: 122
Accepted Solution

Removing dups in a data/set step

Hi,

 

I Know that a 'data/set' step work similar a 'union all' in proc sql

 

data taball;

set tab1 tab2;

run;

 

If there are dups rows in tab1 + tab2, rows that exits in both tables.., is there anyway yo remove dups in the data step?

 

Something similar to 'union' in proc sql

 

Thanks in advance,


Accepted Solutions
Solution
‎06-14-2016 05:21 PM
Respected Advisor
Posts: 3,156

Re: Removing dups in a data/set step

Posted in reply to juanvg1972

In general you will need an additional step, such as proc sort with nodupkey option. But if both of your incoming data are presorted by the keys, you may rub in dedup process in one data step as such:

 

data h1;
input a b;
cards;
1 11 
1 22 
2 12 
;

data h2;
input a b;
cards;
1 11 
2 16 
;

data want;
set h1 h2;
by a b;
if first.b;
run;

View solution in original post


All Replies
Solution
‎06-14-2016 05:21 PM
Respected Advisor
Posts: 3,156

Re: Removing dups in a data/set step

Posted in reply to juanvg1972

In general you will need an additional step, such as proc sort with nodupkey option. But if both of your incoming data are presorted by the keys, you may rub in dedup process in one data step as such:

 

data h1;
input a b;
cards;
1 11 
1 22 
2 12 
;

data h2;
input a b;
cards;
1 11 
2 16 
;

data want;
set h1 h2;
by a b;
if first.b;
run;
☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 1 reply
  • 217 views
  • 0 likes
  • 2 in conversation