cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
lydiawawa
‎03-17-2023
  • 149 Posts
  • 121 Likes Given
  • 1 Solutions
  • 6 Likes Received

How to output population standard deviation on SAS

by Lapis Lazuli | Level 10 in SAS Programming
‎08-04-2021 09:20 AM
‎08-04-2021 09:20 AM
Hi,   I'm trying to output population standard deviation , not just standard deviation. On SQL, it is simple as using the std_pop. Is there anyway on SAS that I can turn the keys on proc univariate and proc means? ... View more

Re: Union distinct records from multiple datasets

by Lapis Lazuli | Level 10 in SAS Programming
‎03-03-2021 01:34 PM
‎03-03-2021 01:34 PM
The full log is rather long, the code is still running. Following is a portion of mprint and symbolgen. There seems to be no problem with macro variable definition: 156 data demo; 157 set data_set_list; 158 str = catt('%summarize(dsn=', dsn,');'); 159 call execute(str); 160 run; MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_01 MPRINT(SUMMARIZE): ods select none; NOTE: The macro generated output from MPRINT will also be written to external file /home/s/shia0001/tempout while OPTIONS MPRINT and MFILE are set. SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_01 MPRINT(SUMMARIZE): proc means data=mylib.DATA_01 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_01 MPRINT(SUMMARIZE): DSN = "mylib.DATA_01"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_02 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_02 MPRINT(SUMMARIZE): proc means data=mylib.DATA_02 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_02 MPRINT(SUMMARIZE): DSN = "mylib.DATA_02"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_04 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_04 MPRINT(SUMMARIZE): proc means data=mylib.DATA_04 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_04 MPRINT(SUMMARIZE): DSN = "mylib.DATA_04"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_05 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_05 MPRINT(SUMMARIZE): proc means data=mylib.DATA_05 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_05 MPRINT(SUMMARIZE): DSN = "mylib.DATA_05"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_06 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_06 MPRINT(SUMMARIZE): proc means data=mylib.DATA_06 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_06 MPRINT(SUMMARIZE): DSN = "mylib.DATA_06"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_08 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_08 MPRINT(SUMMARIZE): proc means data=mylib.DATA_08 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_08 MPRINT(SUMMARIZE): DSN = "mylib.DATA_08"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_09 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_09 MPRINT(SUMMARIZE): proc means data=mylib.DATA_09 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_09 MPRINT(SUMMARIZE): DSN = "mylib.DATA_09"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_10 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_10 MPRINT(SUMMARIZE): proc means data=mylib.DATA_10 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_10 MPRINT(SUMMARIZE): DSN = "mylib.DATA_10"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_11 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_11 MPRINT(SUMMARIZE): proc means data=mylib.DATA_11 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_11 MPRINT(SUMMARIZE): DSN = "mylib.DATA_11"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_12 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_12 MPRINT(SUMMARIZE): proc means data=mylib.DATA_12 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_12 MPRINT(SUMMARIZE): DSN = "mylib.DATA_12"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_13 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_13 MPRINT(SUMMARIZE): proc means data=mylib.DATA_13 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_13 MPRINT(SUMMARIZE): DSN = "mylib.DATA_13"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_15 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_15 MPRINT(SUMMARIZE): proc means data=mylib.DATA_15 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_15 MPRINT(SUMMARIZE): DSN = "mylib.DATA_15"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc datasets lib=work nodetails nolist; MPRINT(SUMMARIZE): delete _temp1 _temp2; MPRINT(SUMMARIZE): quit; MLOGIC(SUMMARIZE): Ending execution. MLOGIC(SUMMARIZE): Beginning execution. MLOGIC(SUMMARIZE): Parameter DSN has value mylib.DATA_16 MPRINT(SUMMARIZE): ods select none; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_16 MPRINT(SUMMARIZE): proc means data=mylib.DATA_16 SUM NWAY; MPRINT(SUMMARIZE): class id; MPRINT(SUMMARIZE): var cnt; MPRINT(SUMMARIZE): ods output summary = _temp1; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): ods select all; MPRINT(SUMMARIZE): data _temp2; MPRINT(SUMMARIZE): set _temp1; SYMBOLGEN: Macro variable DSN resolves to mylib.DATA_16 MPRINT(SUMMARIZE): DSN = "mylib.DATA_16"; MPRINT(SUMMARIZE): run; MPRINT(SUMMARIZE): proc append base=final data=_temp2 force; MPRINT(SUMMARIZE): run; This is the error for every iteration:   NOTE: There were 52 observations read from the data set WORK.DATA_SET_LIST. NOTE: The data set WORK.DEMO has 52 observations and 2 variables. NOTE: Compressing data set WORK.DEMO increased size by 100.00 percent. Compressed is 2 pages; un-compressed would require 1 pages. NOTE: CALL EXECUTE generated line. 1 + ods select none; proc means data=mylib.DATA_01 SUM NWAY; class id; var cnt; ods output summary = _temp1; run; ods select all; data _temp2; set _temp1; DSN = "mylib.DATA_01"; run; proc append base=final data=_temp2 force; run; proc datasets NOTE: Data file mylib.DATA_01.DATA is in a format that is native to another host, or the file encoding does not match the session encoding. Cross Environment Data Access will be used, which might require additional CPU resources and might reduce performance. NOTE: The data set WORK._TEMP1 has 2056463 observations and 3 variables. NOTE: There were 6731208 observations read from the data set mylib.DATA_01. NOTE: PROCEDURE MEANS used (Total process time): real time 2:30.77 cpu time 1:38.38 NOTE: There were 2056463 observations read from the data set WORK._TEMP1. NOTE: The data set WORK._TEMP2 has 2056463 observations and 4 variables. NOTE: Compressing data set WORK._TEMP2 increased size by 17.25 percent. Compressed is 1774 pages; un-compressed would require 1513 pages. NOTE: DATA statement used (Total process time): real time 14.45 seconds cpu time 0.82 seconds ERROR: An exception has been encountered. Please contact technical support and provide them with the following traceback information: The SAS task name is [APPEND ] Segmentation Violation Traceback of the Exception: /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sas(+0x16a23e) [0x5594e557d23e] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sas(+0x4eddf) [0x5594e5461ddf] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/tkmk.so(bkt_signal_handler+0x1 44) [0x7f52ae353ac4] /lib64/libpthread.so.0(+0xf630) [0x7f52af97c630] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxkern(yyrgreb+0x37) [0x7f52a0477a57] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxkern(yyrcgix+0x1e3) [0x7f52a047ae23] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxkern(yyrcgef+0xbb) [0x7f52a047abeb] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyh(+0x38490) [0x7f529b980490] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyh(+0x37797) [0x7f529b97f797] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyh(yyhlock+0x8e5) [0x7f529b97bcf5] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyoio(yyoopen+0x810f) [0x7f527182fa9f] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyoio(yoopen+0x1f7) [0x7f52718275b7] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxshel(+0x64228) [0x7f5292d27228] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxshel(ysssem+0x21c8) [0x7f5292d24258] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxshel(ysprstm+0xbf8) [0x7f5292d2ac08] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxshel(yspproc+0x37e) [0x7f5292d2b47e] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasqutil(xsparse+0x95) [0x7f524b5b0115] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasqutil(sasqutil+0x436) [0x7f524b55c146] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sas(vvtentr+0x18a) [0x5594e546193a] /lib64/libpthread.so.0(+0x7ea5) [0x7f52af974ea5] /lib64/libc.so.6(clone+0x6d) [0x7f52aef609fd] ... View more

Re: Union distinct records from multiple datasets

by Lapis Lazuli | Level 10 in SAS Programming
‎03-03-2021 12:31 PM
‎03-03-2021 12:31 PM
Hi Reeza,   I do not have sashelp.vtables available on my SAS   I used this statement instead:   proc sql; create table data_set_list as select cats('mylib.',memname) as dsn from dictionary.tables where libname= "mylib" and upcase(memname) like "DATA_%" ; The following is the rest code:   %macro summarize(dsn=); ods select none; proc means data=&dsn SUM NWAY; class id; var cnt; ods output summary = _temp1; run; ods select all; data _temp2; set _temp1; DSN = "&DSN"; run; proc append base=final data=_temp2 force; run; proc datasets lib=work nodetails nolist; delete _temp1 _temp2; quit; %mend; data demo; set data_set_list; str = catt('%summarize(dsn=', dsn,');'); call execute(str); run; The following are the first few errors I received: ERROR: An exception has been encountered. Please contact technical support and provide them with the following traceback information: The SAS task name is [APPEND ] Segmentation Violation Traceback of the Exception: /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sas(+0x16a23e) [0x5594e557d23e] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sas(+0x4eddf) [0x5594e5461ddf] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/tkmk.so(bkt_signal_handler+0x1 44) [0x7f52ae353ac4] /lib64/libpthread.so.0(+0xf630) [0x7f52af97c630] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxkern(yyrgreb+0x37) [0x7f52a0477a57] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxkern(yyrcgix+0x1e3) [0x7f52a047ae23] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxkern(yyrcgef+0xbb) [0x7f52a047abeb] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyh(+0x38490) [0x7f529b980490] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyh(+0x37797) [0x7f529b97f797] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyh(yyhlock+0x8e5) [0x7f529b97bcf5] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyoio(yyoopen+0x810f) [0x7f527182fa9f] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasyoio(yoopen+0x1f7) [0x7f52718275b7] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxshel(+0x64228) [0x7f5292d27228] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxshel(ysssem+0x21c8) [0x7f5292d24258] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxshel(ysprstm+0xbf8) [0x7f5292d2ac08] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasxshel(yspproc+0x37e) [0x7f5292d2b47e] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasqutil(xsparse+0x95) [0x7f524b5b0115] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sasqutil(sasqutil+0x436) [0x7f524b55c146] /apps/SAS/v9.4/SASHome/SASFoundation/9.4/sasexe/sas(vvtentr+0x18a) [0x5594e546193a] /lib64/libpthread.so.0(+0x7ea5) [0x7f52af974ea5] /lib64/libc.so.6(clone+0x6d) [0x7f52aef609fd] NOTE: PROCEDURE APPEND used (Total process time): real time 2.50 seconds cpu time 0.01 seconds NOTE: The SAS System stopped processing this step because of errors. 2 + lib=work nodetails nolist; delete _temp1 _temp2; quit;;       ... View more

Re: Union distinct records from multiple datasets

by Lapis Lazuli | Level 10 in SAS Programming
‎03-03-2021 12:56 AM
‎03-03-2021 12:56 AM
Thank you for the helpful response, when I tested with my datasets there is not enough memory to complete the program. ... View more

Re: Union distinct records from multiple datasets

by Lapis Lazuli | Level 10 in SAS Programming
‎03-02-2021 07:23 PM
‎03-02-2021 07:23 PM
I posted the macro I attempted to create, the min you posted this lol... ... View more

Re: Union distinct records from multiple datasets

by Lapis Lazuli | Level 10 in SAS Programming
‎03-02-2021 07:21 PM
‎03-02-2021 07:21 PM
I tried to create union statements in macro, then execute it through pro sql   /*Get dataset names*/ proc sql noprint; select memname into :mylist separated by ' ' from dictionary.tables where libname= "mylib" and upcase(memname) like "DATA_%" ; quit; %put &mylist; /*create union statements*/ %global nextdata; %let nextdata =; %macro combinedata(mylist); data _null_; datanum = countw("&mylist"); call symput('Dataset', put(datanum, 10.)); run; %do i = 1 %to &Dataset ; data _null_; temp = scan("&mylist", &i); call symput("Dataname", strip(put(temp,$12.))); run; %put &Dataname; %put &Dataset; %if (&i=&Dataset) %then %do; %let nextdata = &nextdata. select id, sum(cnt) from mylib.&&Dataname group by id; %end; %else %do; %let nextdata = &nextdata. select id, sum(cnt) from mylib.&&Dataname union group by id; %end; %put nextdata = &nextdata; %end; %mend combinedata; %combinedata(&mylist); /*execute from proc sql*/ proc sql; create table combined as (&nextdata); quit;  I have tried my best, but for some reason the macro segments of selecting unique id and sum id is not formatted correctly for proc sql, yet I do not know how to fix the error.   Any help is appreciated. ... View more

Re: Union distinct records from multiple datasets

by Lapis Lazuli | Level 10 in SAS Programming
‎03-02-2021 07:03 PM
‎03-02-2021 07:03 PM
Unfortunately, it is not sorted... ... View more

Re: Union distinct records from multiple datasets

by Lapis Lazuli | Level 10 in SAS Programming
‎03-02-2021 04:52 PM
‎03-02-2021 04:52 PM
Typo: The name of the new table should be combined instead of new_data1 ... View more

Union distinct records from multiple datasets

by Lapis Lazuli | Level 10 in SAS Programming
‎03-02-2021 04:48 PM
‎03-02-2021 04:48 PM
Hi, I have about 100 large datasets and within each dataset I need to extract distinct IDs with a sum of another variable by ID, and eventually join aggregated datasets vertically.   The datasets are named as data_01 , data_02, data_03 ....data_100. I have tried to use this before aggregation:             data combined;                   set data_:;            run; The code runs extremely slow to the point of not moving at all, which requires me to select distinct IDs and calculate sum by ID before setting them together   /*to get dataset name*/ %let mylist=; proc sql noprint; select catt(libname, '.', memname) into :mylist separated by ' ' from dictionary.tables where libname="mylib" and memname like 'data_%' ; quit; After getting the dataset names I will need to use proc sql to union join distinct IDs with aggregated sums, such as     proc sql; create table new_data1 as select ID, sum(cnt) from data_01 union select ID, sum(cnt) from data_02 ......... group by ID; quit;     How do I automate the steps to vertically combine the 100 datasets with prior conditions?   Thanks!         ... View more

Re: How to stack datasets with similar names, but excludes some

by Lapis Lazuli | Level 10 in SAS Programming
‎12-17-2020 08:02 PM
‎12-17-2020 08:02 PM
No, this is not what I was asking, I tried to set the datasets with names stored in the macro variables, dsn, but the way it is written only considered the datasets stored in WORK folder. ... View more

Re: How to stack datasets with similar names, but excludes some

by Lapis Lazuli | Level 10 in SAS Programming
‎12-17-2020 06:54 PM
‎12-17-2020 06:54 PM
the tables in dsnlist are not in work library, how do I set those datasets by pointing to a library? I tried data want; set mylib1.&dsnlist; run; Only first dataset was grabbed from the library ... View more

Re: How to stack datasets with similar names, but excludes some

by Lapis Lazuli | Level 10 in SAS Programming
‎12-17-2020 06:51 PM
‎12-17-2020 06:51 PM
the tables are not in work library, how do I set the datasets in dsn with a library name? ... View more

How to stack datasets with similar names, but excludes some

by Lapis Lazuli | Level 10 in SAS Programming
‎12-17-2020 05:03 PM
‎12-17-2020 05:03 PM
Hi All,   I have many datasets with similar suffix such as: dataset_01 dataset_02 dataset_03 dataset_03_v2 dataset_04 dataset_05_v2   I'm trying to stack all of them together excluding the ones with _v2, which cannot be achieved by just using data want;   set dataset_: ; run;   Is there an efficient way to exclude by conditions?   Thank you!     ... View more

Records by condition exist in proc freq, but subset by condition retur...

by Lapis Lazuli | Level 10 in SAS Programming
‎11-20-2020 03:39 PM
‎11-20-2020 03:39 PM
Hi All,   I'm trying to subset a dataset by using where clause on a variable, v_h, with the following format.   v_h :  type = Num, Len = 8, Format = 4.1, Informat = 4.1   When using proc freq on v_h, there are records of v_h = 1.4, but when using where clause to filter the dataset by v_h = 1.4, there are 0 records /*returned 0 records*/ data test; set have(where=(v_h=1.4)); run; data test; set have; if v_h = 1.4; run; I also received a message : "NOTE: Data file have.DATA is in a format that is native to another host, or the file encoding does not match the session encoding. Cross Environment Data Access will be used, which might require additional CPU resources and might reduce performance."   Could anyone help me to figure out what went wrong?   Thanks!     ... View more
Contact Me
Online Status
Offline
Date Last Visited
‎03-17-2023 03:41 AM
Likes given to
Likes from
View All
Quick links