topic Re: concatenating in SAS Procedures

concatenating

R_A_G_ — Sun, 05 Jun 2011 16:18:13 GMT

Hello,

I have 150 files named TEMP_&seed

seed=1 to 150

I want to stack them in order but when I use the following syntax they files are not ordered right. Why?
my codes:
data SAP.result;
set SAP.TEMP_:;
run;
Thank you

Re: concatenating

Peter_C — Sun, 05 Jun 2011 17:06:36 GMT

You are going to need to take control.
PROC SQL noprint ;
Select memname, input( scan( memname, -1, '_' ), best8.) as suffix_number
Into :name_list separated by ' ' , :other
From dictionary.tables
where libname = 'SAP' and memname like 'TEMP%'
Order by suffix_number
;

Re: concatenating

data_null__ — Sun, 05 Jun 2011 20:05:34 GMT

Use

set temp_1-temp_150 open=defer; Removed slash / from SET statement, would cause an error.

Message was edited by: data _null_;

Re: concatenating

R_A_G_ — Sun, 05 Jun 2011 23:33:58 GMT

thank you that simple set statement works

Re: concatenating

R_A_G_ — Mon, 06 Jun 2011 00:05:14 GMT

Hello,
I was wondering what does " / open=defer" do in that statement?

Thanks

Re: concatenating

ArtC — Mon, 06 Jun 2011 05:28:23 GMT

the open=defer causes the data sets to only be opened when they are ready to be read. Otherwise all 150 data sets would have to be open at one time (the default). Under some (most I would assume) OSs there are limits as to the number of open data sets.

Using the colon operator in your original code allowed the data sets to be read as they were encountered, which was apparently not in named order.

Re: concatenating

data_null__ — Mon, 06 Jun 2011 13:56:46 GMT

Don't use the / that was an error.

As mentioned OPEN=DEFER does just that defers opening the files until they are read. The files must contain exactly the same variables to use Deferred opening which you implied. If not you may have to concatenate in smaller groups.

Re: concatenating

Ksharp — Tue, 07 Jun 2011 01:47:16 GMT

How about:
[pre]
data SAP.result;
set SAP.TEMP_:;
by id;
run;
[/pre]

Ksharp

Re: concatenating

R_A_G_ — Mon, 13 Jun 2011 20:46:02 GMT

Hi KSharp,

The id code does not work. I need these files to be stacked in order. Ex: 1st OUT1 2nd OUT2, 3rd OUT3 and so on.

thanks

Re: concatenating

sbb — Mon, 13 Jun 2011 20:51:17 GMT

To the OP: Peter.C provided you a suitable solution, where a macro variable is generated and you have total control how you might want to sequence the files. Have a look back at the thread for details.

Scott Barry
SBBWorks, Inc.

Re: concatenating

Ksharp — Tue, 14 Jun 2011 03:28:26 GMT

Oh.I misunderstood what you mean.But you can use variable listing to get it.I tested it successfully by SAS 9.2

[pre]
libname xx 'c:\temp';
data want;
set xx.makedata1 - xx.makedata4;
run;
[/pre]

Ksharp

Re: concatenating

R_A_G_ — Tue, 14 Jun 2011 16:04:24 GMT

thanks Ksharp this simple and short code works well.
R.A.G.