topic Re: duplicates check in a given library. in SAS Procedures

duplicates check in a given library.

sassharp — Tue, 30 Jul 2013 21:38:38 GMT

There are A, B, C libraries.

In each library x, y, z number of data sets.

In A library the data sets range from a1,a2,.....,ax

In B library the data sets range from b1,b2,b3,...,by

In C library also the data sets range from c1,c2,c3,....cz

Now we need to check each data set and need to see are there any duplicates present?

and need to write the required information into final dataset. It should contain these columns.

library datasetname totalobservations duplicatescount

Re: duplicates check in a given library??

Haikuo — Tue, 30 Jul 2013 21:44:26 GMT

Homework?

Re: duplicates check in a given library??

Reeza — Tue, 30 Jul 2013 21:45:38 GMT

So what's the question? What is considered a duplicate?

Have you tried querying the sashelp.vtable or dictionary.tables? It will give you columns 1-3, so you really only need column 4.

Re: duplicates check in a given library??

UrvishShah — Wed, 31 Jul 2013 07:24:59 GMT

Hi,

How about the following one...it will be good if you post some sample data and output you want...

However,here is my try based on my understanding of your requirement...

proc sql;

create table test as

select libname as lib_name,memname as dsn,

nobs as tot_obs

from sashelp.vtable

where libname ^in ("SASHELP","SASUSER","WORK")

order by libname;

quit;

proc sort nodupkey data = test dupout = test1;

by dsn;

run;

proc sql noprint;

select distinct compress(quote(dsn)) into :duplicates_dsn separated by ","

from test1;

create table test1 as

select lib_name,dsn,tot_obs,count(dsn) as tot_dup

from test1

group by dsn;

quit;

%put &duplicates_dsn. &tot_dup.;

data want;

set test test1;

by dsn;

if tot_dup = . then tot_dup = 0;

run;

-Urvish

Re: duplicates check in a given library??

jakarman — Wed, 31 Jul 2013 07:38:44 GMT

proc compare?

Re: duplicates check in a given library??

sugeshnambiar — Wed, 31 Jul 2013 08:07:42 GMT

you have it right !!! you could include filesize as well ...

Re: duplicates check in a given library??

sassharp — Wed, 31 Jul 2013 20:40:27 GMT

Helpfull Answer.

Re: duplicates check in a given library.

Scott_Mitchell — Thu, 01 Aug 2013 01:14:08 GMT

Reeza is right, you need to specify exactly what you consider a duplicate.

Is it a duplicate observation? Or a duplicate value in each of the variables? Even duplicate values for a single observation across multiple variables.

You said Urvish's answer was helpful, so what do you actually need?

Re: duplicates check in a given library.

sassharp — Thu, 01 Aug 2013 16:21:47 GMT

From Urvish's answer I fullfilled my requirement. Looked for duplicate value in key variable.

We can mark this one as answered. But, I dont see correct answer, helpful answer buttons in this thread.

Thanks all.