topic Re: Proc compare - comparing variables in two datasets that have different sizes and different variable placement in SAS Programming

Proc compare - comparing variables in two datasets that have different sizes and different variable placement

Dontik — Wed, 17 Sep 2014 09:25:23 GMT

So, I have a significant problem with proc compare. I have two datasets with the two columns. One column lists table names and the other one - names of variables which correspond to table names from the first column. I want compare values of one of them based on the values of first column. I somewhat made it work but the thing is that these datasets have different sizes due to additional values in one of them. Which means that some new variable was added in the middle of a dataset (new variable was added to a table). Unfortunately, proc compare compares values from two datasets horizontally and checks them against each other for values, so in my case it looks like this:

ds 1 | ds 2

cost | box_nr

other | cost_total

As you can see, a new value `box_nr` was added to the second dataset that appears above the value that I want it to compare variable `cost` to (`cost_total`). So I would like to know if it's possible to compare values (check for differences in character sequence) that have at least minimal similarity - for example 3 letters (cos) or if it's possible to just put values like `box_nr` at the end suggesting that they don't appear in a certain dataset.

My code:

    PROC Compare base=USERSPDS.MIzew compare=USERSPDS.MIwew
        out=USERSPDS.result outbase outcomp outdif noprint;
        id 'TABLE HD'n;
        where ;
    run;

    proc print data=USERSPDS.result noobs;
       by 'TABLE HD'n;
       id 'TTABLE HD'n;
       title 'COMPARISON:';
    run;

Re: Proc compare - comparing variables in two datasets that have different sizes and different variable placement

RW9 — Wed, 17 Sep 2014 09:30:44 GMT

Your better off using proc sql, joining the two tables - assuming columns are DATASET, VAR_NAME:

proc sql;

create table MATCHES as

select COALESCE(A.DATASET,B.DATASET) as DATASET,

COALESCE(A.VAR_NAME,B.VAR_NAME) as VAR_NAME,

case when A.DATASET="" or A.VAR_NAME="" then "N" else "Y" as IN_BASE,

case when B.DATASET="" or B.VAR_NAME="" then "N" else "Y" as IN_COMP,

from BASE_DATASET A

full join COMP_DATASET B

on A.DATASET=B.DATASET

and A.VAR_NAME=B.VARNAME;

quit;

This will give a full list of all dataset/varname combinations and a flag if its present in either.

Re: Proc compare - comparing variables in two datasets that have different sizes and different variable placement

Dontik — Wed, 17 Sep 2014 11:02:58 GMT

Thank you.

Re: Proc compare - comparing variables in two datasets that have different sizes and different variable placement

Dontik — Wed, 17 Sep 2014 12:12:05 GMT

And what if I don't want to see values that are present in both of these datasets?

Re: Proc compare - comparing variables in two datasets that have different sizes and different variable placement

RW9 — Wed, 17 Sep 2014 12:14:41 GMT

Change:

and A.VAR_NAME=B.VARNAME;

quit;

To:

and A.VAR_NAME=B.VARNAME

where IN_BASE="N" or IN_COMP="Y";

/* note may need to replace with where CALCULATED IN_BASE="Y"... */

quit;