BookmarkSubscribeRSS Feed
Fluorite | Level 6

I was trying to merge two datasets and I used proc compare to check before I merged them, below is the result from proc compare


Screenshot 2023-04-25 202057.png

The code I used to merge datasets is

proc sort data=LC.FAM;
by pid;

proc sort data=hepa;
by PID;

data combined1;
    merge LC.FAM  hepa ;
    by PID;

I got a new dataset with 50273 rows, which contains more rows than hepa (50032 obs). Did anyone know why this happens?


This can happen if there are duplicates in the data, or if there are mis-matches (e.g. values for pid in lc.fam that are not in hepa).


Running PROC COMPARE is an interesting idea.  You usually use PROC COMPARE to compare variables, but it will also tell you if you have duplicate values, or if you have mis-matches.  What do you get if you run:


proc compare base=hepa compare=lc.fam ;
  id pid ; *use an ID statement here, not a BY statement;
run ;
Check out the Boston Area SAS Users Group (BASUG) video archives:
Super User Tom
Super User

There is no way to know in advance how many observations the merge will generate.  Unless you know the values of PID in both datasets.


If HEPA has 100 observations that are each a distinct value of PID

And FAM has 10 observations that are each a distinct value of PID


Then merging them can result in between 100 observations (all of the values of PID in FAM already existed in HEPA) to 110 observations (none of the values of PID in FAM existed in HEPA).


And if either dataset has multiple observations for the same PID then even stranger things can happen.

Lapis Lazuli | Level 10

In addition to abovementioned comments, if you need to merge based on PID.HEPA then use conditional merge, or SQL joins, then you get the 50032 obs. 


data combined1;
    merge LC.FAM (in=a)  hepa (in=b);
    by PID;
    if b;




Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.

If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website. 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Get the $99 certification deal.jpg



Back in the Classroom!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 4 replies
  • 5 in conversation