10-26-2017 03:12 PM
I am having a bit of trouble with replicating every row in my dataset n times.
The idea is to merge 4003 subjects from 44 groups, replicated 1000 times, with 1000 rows of logistic model parameter estimates from 1000 bootstrapped samples of my original data, for each of the 4003 subjects. Each subject has1000 consecutive rows (1,1,1,...(1000 times), 2,2,2,...), and the 1000 parameter estimate rows need to be repeated (1,2,3...1000, 1,2,3,...1000, (4003 times)).
I'm going to then evaluate each subject with the 1000 logistic models, and then find the mean and se for the odds ratio CI, by group.
Any help is greatly appreciated.
10-26-2017 04:08 PM
Are you sure you don't want to do a many to one merge instead? If you really want to make copies of observations, just used a DO loop.
data class(drop=i); set sashelp.class; do i = 1 to 1000; output; end; run;
10-26-2017 04:44 PM
YES, this worked for me:
do i = 1 to 4003;
do j = 1 to n;
set Project2.Beta3 nobs=n point=j;
10-27-2017 12:04 AM - edited 10-27-2017 12:27 AM
Reading a file 4003 times using the POINT= approach (i.e. direct access to records) is probably a lot slower than finding a way to let SAS use its intrinsically faster sequential access. And if your dataset is large, it's worth finding a faster approach that effectively uses SAS sequential data access engine. Beyond that, using PROC append would be more like a "bulk load" of the data.
Of course you really don't want to run 4003 iterations of PROC APPEND. And you don't have to. This program concatenates the data set to itself, meaning it doubles in size at every iteration. So if you were to ask for N=4096, you'd have 12 iterations. For N=4003, you have 11 iterations and a 12th "partial" iteration, adding a fraction of the data set to itself.
%let nreps=4003; data _null_; maxpower=floor(log2(&nreps)); put maxpower=; call execute('data class;set sashelp.class;run;'); do power=1 to maxpower; call execute('proc append base=class data=class;run;'); end; if 0 then set sashelp.class nobs=nrecs; obs_to_add=nrecs*(&nreps - 2**maxpower); if obs_to_add>0 then call execute(cats('proc append base=class data=class (obs=',obs_to_add,');run;')); run;
Need further help from the community? Please ask a new question.