Hi All,   I managed to import zipped CSV files using the following code:   FILENAME ZIPFILE SASZIPAM "Z:\Data\fname001.zip"; data work.imported. (COMPRESS = YES); infile ZIPFILE(fname001.csv) delimiter = ',' MISSOVER DSD lrecl=32767 firstobs=2; informat a b c ; format a b c; input a b c; run; However, sometimes when I am importing large CSV files (~4.5m rows, >8GB in without zipping), I encountered I/O error.     After trial and error, I noticed that I can successfully import using the above code by reducing the observation read in by 1 row, using the OBS= option after FIRSTOBS=2;   This brought me two questions: Why was there an I/O error only when the last row included? How can I know the total number of rows in the CSV file so that I can skip the last row when building an import macro? Thanks. ... View more

I was trying to do a many-to-many hash join.    use sashelp.class as base table, I added extra row to get a data set with duplicated Name: data work.class; set sashelp.class end=eof; if eof then do; Name = 'Alice' ; Sex='F' ; age=20 ; height=60 ; weight=159 ; end; run;   Then, I created a lookup table: data work.lkup; input name $ Var1 Var2; datalines; Alice 12 54 Jack 13 56 James 4 6 Alice 37 25 ; run;   I managed to created a left join by using the following code: data work.test; set work.class; if _N_ =1 then do; if 0 then set lkup; declare hash h(dataset: 'lkup', hashExp:16 , multidata: 'y'); h.defineKey('name');; h.defineData(all:'y'); h.defineDone(); end; if h.find() then do; call missing (of _all_); output; end; if not h.find();output; if not h.find_next();output; run;   but the bolded call missing statement clear out all of the variable, both data from class and lkup.    So instead of manually using the following code to clear out non-matched results call missing (var1 var2); is there any other way I can call missing var1 and var2 easily? (I am trying to apply the logic by using a lookup table with lots of variables.)     Thanks. ... View more

I have written the following code to perform a hash merge within a data-step.   but the steps after the join is not porforming correctly.   data out_set; set in_set; length var1 var2 8; if _n_ =1 then do; declare hash h1(dataset: 'lkup_1',multidata:'y'); rc= h1.defineKey('key1'); rc= h1.defineData('var1'); rc= h1.defineDone(); declare hash h2(dataset: 'lkup_2' , multidata:'y'); rc= h2.defineKey('key2'); rc= h2.defineData('var2'); rc= h2.defineDone(); end; rc= h1.find(); rc= h2.find(); output; do while (rc=0); rc= h1.find_next(); rc= h2.find_next(); if rc = 0 then output; end; miss_flag = missing(var1); run; All of the MISS_FLAG are returning null even for obs where var1 is not missing.  Ideally, I would like to perform the follows and replace the MISS_FLAG:   VAR = ifn(missing(VAR1), VAR2, VAR1); drop VAR1 VAR2 rc; Somehow the drop statement was working, but the step above was not. So i tried to investigate with the miss_flag variable.     Anyone could point me to the right direction would be great.   Thanks. ... View more