Does SQL do this job ? proc sql; select id from small intersect select id from big; quit; ... View more

Kurt directed you to the PDV.  I emphasize this when I teach intro classes.  In the very least, the order of your data sets in the MERGE statements is wrong: dataset2.VARIABLE2 will overwrite dataset1.VARIABLE1.  As in the SAS-L era, consider posting a description of your data and your goals.   When we need to assume, then we may speculate wildly.   HTH,   Kevin ... View more

Try this (tested):   data letters;       input Variable1 Variable2 $ Variable3 $5.;       datalines; 1 W 3.2 1 X 5.1 2 X 7.0 3 E 8.9 3 W 1.3 ; run; data nodup;       set letters;       by variable1;       if first.variable1=1 then output; run;   data dup;       set letters;       by variable1;       if first.variable1=0 then output;       rename variable2=Variable4 variable3=Variable5; run; data nodup_dup;       merge nodup dup;       by variable1;       if variable4="" then variable4="NULL";       if variable5="" then variable5="NULL"; run; ... View more

Although there are millions of rows, it is not going to generate hundreds of columns. Because, the number of Variable2 values (categories) are limited; it is probably about 10 . So it means that I am going to have 9*2 = 18 new expanded columns.   Again, the purpose is to use this file to merge with another dataset. It makes it easier to review the databse once I have only unique Variable1 values in 1st column.    Thank you ... View more

use operator ?? to set them all missing .   input a : ?? ddmmyy10. b : ?? best32. c : ?? $20. ............ ... View more

I think I found another source of problem. Please see my attached screen shot. It shows one of my csv files ..    Now, my question is how to ask SAS to DELETE any non-consistant row (with the specified data type/format) while running the code? ... View more

@ballardw is correct, fix the import/input first then you will have read all the files the same way and will not have this issue. ... View more

No, that I got connected to the local machine, it seems that the "filename" statement is fine. But, there should be something wrong with the "data" statement. Could you please advise?     filename two ("/v_share/Xiaomin/SCOPES/sas_dataset/Oct-08-2015/ScopesCalculations_SecondaryConstruction_ 01_10092015_1158.csv" "/v_share/Xiaomin/SCOPES/sas_dataset/Oct-08-2015/ScopesCalculations_ScopesCalculations_SecondaryConstruction_ 02_10092015_1219.csv");   data test; infile two; INPUT C_ST; run;       ERROR:    /v_share/Xiaomin/SCOPES/sas_dataset/Oct-08-2015/ScopesCalculations_ScopesCalculations_SecondaryConstruction_ 02_10092015_1219.csv. FATAL: Unrecoverable I/O error detected in the execution of the DATA step program. Aborted during the EXECUTION phase.   Thank you ... View more