Thanks very much. ... View more

Thanks Tom. That works. ... View more

SAS is also installed on the same PC. I am doing a long data processing job. Most of the tasks will be performed in SAS. Stata is very efficient to perform an intermediate task. Thus, I want to use Stata from within SAS to do that specific job and then import the generated data into SAS to do the remaining task. Can you please give an example of the x command? ... View more

Thanks for your time on this. I have now received a data dictionary from the data provider with the length of every variable (attached). I have created the lent variable as the argument in the length statement and put that variable into the a macro "lentq" by each group (named as dataset in the length1 file). Can i run a loop to pass through all the 23 files types and assign correct length to all the variables, given that I will convert all the variables to character? proc sql noprint; select distinct lent into :lentq separated by ' ' NOTRIM /* Creating the macro variable lentq containing the length argument for the variables in the specific dataset of "&group" */ from length1 (where =(dataset=:"&group")); quit; ... View more

Thanks. Got it. Is there any way to change all the TYPE to Character and length to a fixed number by doing some code? This is because I have thousands of files and need to pass a macro through them. ... View more

Thanks Tom. That worked as expected. ... View more

Yes- that's the challenge. The id variables are not unique within the group of by variables. Can something be done using array? ... View more

I found the following error message 1856 filename map 'Myfiles.map'; 1857 data _null_; 1858 file map ; 1859 if _n_=1 then put '{"DATASETS":' / '[{' @ ; 1860 if eof then put '}]'/ '}' ; 1861 1862 set variables end=eof; ERROR: File WORK.VARIABLES.DATA does not exist. 1863 by dsname ; 1864 if first.dsname then do; 1865 if _n_ > 1 then put ',' @; 1866 put '"DSNAME":' dsname :$quote. ',"TABLEPATH":' tablepath :$quote. 1867 / ' ,"VARIABLES":' 1868 / ' [' @ 1869 ; 1870 end; 1871 else put ' ,' @; 1872 put '{"NAME":' name :$quote. ',"TYPE":' type :$quote. ',"PATH":' path :$quote. @ ; 1873 if length then put ',"LENGTH":' length @; 1874 put '}' ; 1875 if last.dsname then put ' ]' ; 1876 run; NOTE: The SAS System stopped processing this step because of errors. NOTE: DATA statement used (Total process time): real time 0.03 seconds cpu time 0.03 seconds ... View more

 I am not sure where I am making the mistake in the following code. The error message is attached. filename dirtree url 'https://raw.githubusercontent.com/sasutils/macros/master/dirtree.sas'; %include dirtree /source2; %dirtree(C:\Users\bayzid\Macquarie University\MRFF Aged care Data - Documents\json_test /* Pipe delimited directory list (default=.) */ , out=filelist /* Output dataset name */ , maxdepth=1 /* Maximum tree depth */); %macro read_json(myfile=); filename mydata &myfile.; libname myjson JSON fileref=mydata filelockwait=600;; proc datasets lib=myjson; quit; *how to parse the file has not been specified - looks like you need to specify the lengths; data file2save; length source $200. p1 $256. Value $256.; set myjson.alldata; source=&myfile.; run; proc append base=master data=file2save force; run; proc sql; drop table file2save; quit; filename mydata; libname myjson; %mend read_json; proc sql; drop table master; quit; data run_list; set filelist; where type='F'; str=catt('%read_json(myfile="C:\Users\bayzid\Macquarie University\MRFF Aged care Data - Documents\json_test', filename, '");'); call execute(str); run; ... View more

Hi Reeza, Wouldn't the JSON libname convert individual files and then append? In that case the main problem of varying variable length  will exist. I am struggling to run your other code which is giving me many error messages. ... View more

Hi Tom, Thanks for the code. It worked for everything else but for the following one. "Diagnosis":"TIA's. L.V.F (left ventricular failure) Rapid A.F. Hypertension (high BP), Asthma, SOB requiring 02, Urinary tract infection, fractured hip (right) approx 12 yrs ago, Pain in lower spine, gastro oesophageal reflux disorder, depression, anxiety. \\", It is pushing the bold words under the name column. ... View more

The problem is with the delimiters. Some of the delimiters are also in some values.   ... View more