Hi Tom, I am here to learn. I tried your code and get table one with varaible C as missing, while table two with variable A as mssing, but still not understand why. Could you explain how the cursor move between input date and A in these dlm=',' and dsd method? Thanks. ... View more

Yes, after comment it, there is no error. Thank you! ... View more

It works, but still need to add some codes to do that for all the 80 files,output file name sepcified after file stament can not be the same as the input file after infile satment, otherwise the file will not be updated. RW9, Thanks for you explains. ... View more

Hi Tom, Thank you. below is my code, I get the column and format list of the variables in log file of proc import, only define the first 100 as the last 26~28 are useless to me. -------------------------------------------------------------------------------------------------------------- filename indata "D:\Temp\EP\*.txt" lrecl=32767; data first;          attrib Lot                 length=$8;          attrib Event               length=$1;          attrib Product             length=$10;          attrib Recipe              length=$10;          attrib Route               length=$10;          attrib Entity              length=$6;          attrib LotList             length=$8;          attrib Date                length=8 informat=ANYDTDTM40. format=DATETIME.;    attrib Time B_oHe_Leak_Rate A_oHe_Leak_Rate B_iHe_Leak_Rate A_iHe_Leak_Rate B_sRF_ref B_sRF B_tRF_ref B_tRF    A_sRF_ref A_sRF A_tRF_ref A_tRF robot_rtn robot_xtn HX_rho_dome HX_rho_wall A_wfr_prsnt HX_T_wall HX_T_dome    A_wfr_T A_rcp_stp A_CNT_T A_TOP_T A_GSH_T A_SID_T A_iIHC_P A_iIHC_flow A_oIHC_P A_oIHC_flow A_bRF A_bRF_ref    A_sO2 A_sAr A_sHe A_sSiH4 A_tHe A_tSiH4 A_tAr A_tO2 A_NF3 A_P A_rTV_stp A_TTV_stp A_echuck_V A_echuck_I B_wfr_prsnt    B_wfr_T B_rcp_stp B_CNT_T B_TOP_T B_GSH_T B_SID_T B_iIHC_P B_iIHC_flow B_oIHC_P B_oIHC_flow B_bRF B_bRF_ref    B_sO2 B_sAr B_sHe B_sSiH4 B_tHe B_tSiH4 B_tAr B_tO2 B_NF3 B_P B_rTV_stp B_TTV_stp B_echuck_V B_echuck_I HX_flow_wall    HX_flow_dome CF_xtn_corr CF_rot_corr A_foreline_P B_foreline_P A_slot B_slot A_elapsed_stp_time B_elapsed_stp_time    buffer_P Buffer_N2_flow Buffer_N20_Setpoint ChamberA ChamberB ChamberC ChamberD Batch Operation length=8;    stop;    call missing(of _all_);    run; csvReader macro definition lines %csvReader(data=first,out=final,fileref=indata,fileNameLength=$500,namerow=4); ------------------------------------------------------------------------------------------------------------------------------------------ and get error for every raw file like below NOTE: The infile INDATA is:       Filename=D:\Temp\EP\141012_040223_0511_K4411740.txt,       File List=D:\Temp\EP\*.txt,RECFM=V,LRECL=32767 NOTE: The data set WORK.CSVREADER_VINFO has 102 observations and 3 variables. ERROR: Invalid data set name at line 9 column 218. ERROR: An error has occurred during instance method OM_OUTPUT(505) of "DATASTEP.HASH". Actually the 218th column in the raw file is empty with column name as "SubEntityId___5", not sure why it get an error in line 9 specifically. ... View more

How to set the length variable after $varying in this case? sorry I am a SAS newbie. "input buffer $varying256.;" get an error as ERROR: Variable name containing length expected after $VARYING ... View more

Hi data_null_, Thanks for your code. But I am kind of get stucked with preparing the input files. The Macro need all the input files with first row as specific variable names, while I can not get that as my files have some header rows above variable name row. ... View more

Hi RW9 Here is what the raw txt files looks like ------------------------------------------------------------------------------------------------------------ # # Date:10/12/2014 12:19:00 AM # Batch:1413044241 Route:FL65.8P1CB Event:N/A Time        A_Rate       A_sRF        B_Rate       B_sRF     CHA       CHB..... 3111          26               16             71                44         TI            FI   ..... 4210          33                18            68                42          AI           EI ...... ...... ------------------------------------------------------------------------------------------------------------- And for example, another file would looks like as below ------------------------------------------------------------------------------------------------------------- # # Date:10/11/2014 10:19:00 AM # Batch:1213043241 Route:FL65.8P1CB Event:N/A Time        A_rate      B_rate     A_srf        B_srf      NR_flow   CHA       CHB..... 3111          26            71           16           44            G           TI            FI   ..... 4210          33            68           15           42            F           AI            EI ...... ...... ----------------------------------------------------------------------------------------------------------------- I am stucked with can not import all the files with column names and format automatically, since there are 3 row headers. ... View more

Thanks. I will try it tomorrow when back to work,  can not login into my desk-top right now. ... View more

The problem here is that I have ~80 files with each have ~126 columns with different sequnce , it's not realistic to use input and specify each column information (type, name, length) one by one Actually this is only the data for one operation step, I need to process ~200 operations like that. So need to find a more systematci way. ... View more

first I tried to remove the header 3 rows of one txt file, use Proc import with datarow=2 to get it in as a first table with correct column names and format, then use input datafile with firstobs=5 to get all the other files in, and append to the first table with proc SQL union. I get the error indicate data type mismatch for some columns. Then I went back to check the data structure by manually remove the 3 header rows of another txt file, import it as the first table above. In log file I can get the column names, format of the variables of these 2 files, I compared the column names, sequence and format of them in excel, and find the difference are only sequence and case of column names ... View more