Where is your data stored? ... View more

1) Are you just looking to import a table (e.g., if the capability were there) a table you could highlight and copy and then paste into SAS? 2) http://support.sas.com/documentation/cdl/en/odsug/61723/HTML/default/viewer.htm#a002233618.htm ... View more

another way: data test; input pk$ name$ no; cards; 1 a 10 2 a 12 3 a 13 4 b 15 5 b 16 6 c 17 ; data temp;   set test;   by name;   count+first.name; run; proc sort; by count pk; proc sql noprint; select max(cct) into : max   from (select count(*) as cct from temp group by name); quit; %put &max; %let max=%trim(%left(&max)); data want; set temp; by count; array p{*}$ pk1-pk&max; array n{*}$ name1-name&max; array o{*}  no1-no&max; retain  pk: name: no:; if first.count then ct=0; ct+1; p{ct}=pk; n{ct}=name; o{ct}=no; if last.count then do;output; call missing(of p{*} n{*} o{*});end; drop pk name no ct count; run; proc print;run; Obs    pk1    pk2    pk3    name1    name2    name3    no1    no2    no3       1      1      2      3       a        a        a         10     12     13       2      4      5                b        b                  15     16      .       3      6                        c                             17      .      . Linlin ... View more

150 million rows of data will require a decent about of memory to store the hash object. 1. Make sure your system has enough memory available total to even store the object. 2. Make sure you setup the sessions memory settings appropirately so that SAS will have that memory available to it. As far as I know the extranious length of a assigned variable does not affect the amount of space required to store it in memory for a hash object.  See the following as proof: 16         data foo; 17          length bar $100; 18          set sashelp.class end=done; 19          orig_age=age; 20          do i=1 to 500000; 21           bar=cats(name,put(i,6.)); 22           age=orig_age+rand('table',.25,.25,.25,.25); 23           output; 24          end; 25          keep bar age; 26         run; NOTE: There were 19 observations read from the data set SASHELP.CLASS. NOTE: The data set WORK.FOO has 9500000 observations and 2 variables. NOTE: DATA statement used (Total process time):       real time           4.83 seconds       user cpu time       4.06 seconds       system cpu time     0.75 seconds       Memory                            2493978k       OS Memory                         2499944k 27         28         data age10(where=(10<=age<15)) age15(where=(15<=age<20)); 29          if 0 then set foo; 30          declare hash ha(dataset:'foo'); 31          declare hiter iter('ha'); 32           ha.definekey('bar'); 33           ha.definedata(all:'y'); 34           ha.definedone(); 35          iter.first(); 36          do while(iter.next()=0); 37           output; 38          end; 39          stop; 40         run; NOTE: There were 9500000 observations read from the data set WORK.FOO. NOTE: The data set WORK.AGE10 has 2374832 observations and 2 variables. NOTE: The data set WORK.AGE15 has 7000595 observations and 2 variables. NOTE: DATA statement used (Total process time):       real time           13.27 seconds       user cpu time       11.93 seconds       system cpu time     1.32 seconds       Memory                            2493978k       OS Memory                         2499944k 16         data foo; 17          length bar $13; 18          set sashelp.class; 19          orig_age=age; 20          do i=1 to 500000; 21           bar=cats(name,put(i,6.)); 22           age=orig_age+rand('table',.25,.25,.25,.25); 23           output; 24          end; 25          keep bar age; 26         run; NOTE: There were 19 observations read from the data set SASHELP.CLASS. NOTE: The data set WORK.FOO has 9500000 observations and 2 variables. NOTE: DATA statement used (Total process time):       real time           5.71 seconds       user cpu time       4.08 seconds       system cpu time     1.56 seconds       Memory                            2493978k       OS Memory                         2499944k       27         28         data age10(where=(10<=age<15)) age15(where=(15<=age<20)); 29          if 0 then set foo; 30          declare hash ha(dataset:'foo'); 31          declare hiter iter('ha'); 32           ha.definekey('bar'); 33           ha.definedata(all:'y'); 34           ha.definedone(); 35          iter.first(); 36          do while(iter.next()=0); 37           output; 38          end; 39          stop; 40         run; NOTE: There were 9500000 observations read from the data set WORK.FOO. NOTE: The data set WORK.AGE10 has 2373910 observations and 2 variables. NOTE: The data set WORK.AGE15 has 7000782 observations and 2 variables. NOTE: DATA statement used (Total process time):       real time           13.78 seconds       user cpu time       11.93 seconds       system cpu time     1.82 seconds       Memory                            2493978k       OS Memory                         2499944k ... View more

If your data are already sorted by pid, then you could just use: data Main;   informat dt date9.;   input Pid $ no Dt;   cards; a1  1  12jan2011 a2  2  12jan2011 a3  3  12jan2011 ; data Incre;   informat dt date9.;   input Pid $ no Dt;   cards; a1  5  18jan2011 a4  6  18jan2011 a5  7  18jan2011 ; data Output;   format dt date9.;   update main incre;   by pid; run; ... View more

data l(drop=sdt edt); input sdt$ 1-9 edt$ 10-20; stdate =input(sdt,date9.); enddate=input(edt,date9.); format stdate enddate ddmmyy10.; cards; 12jan2011 13jan2011 13jan2011 14jan2011 14jan2011 15jan2011 15jan2011 16jan2011 16jan2011 17jan2011 17jan2011 18jan2011 run; proc print; run; see actually i the above table i have the dates on which the loading to be happened In the second table in one cell i will have the Sdate and Edate so i want one table with one obs of date so that Ex: Table 2 Sdate         Edate        Path      Data            Fpath 12012011    13012011   c/raw/    order.txt      c/raw/12012011/order.txt I want the dates  to go to another table in the Infile path of the job i will give Fpath in the macro so that it will take data from there daily if the job again runs the date should increment so i will run for 13 date this is my aim for the loading data based on date Sdate         Edate        Path      Data            Fpath 13012011    14012011   c/raw/    order.txt      c/raw/13012011/order.txt If it is messy refer the text file ... View more

Patrick. Tom means 'A0'x   not '0A'x ... View more

It would help to know what your data really look like.  The following post shows to methods for seeing the hex representation of your data, one using SAS and one using a nice freeware tool ( http://www.listserv.uga.edu/cgi-bin/wa?A2=ind0905B&L=sas-l&P=R4105&D=1&H=0&O=D&T=1 ) called hexmad. Sometimes, what seems like unexplained characters, is actually a different kind of file that can easily be addressed if one knows the kind of file it is. In short, the Forum could probably advise you much better if they could see the hex representation of one or a couple of your data records. ... View more