topic Re: trying to import csv file that have 6800000 observation in SAS Programming

trying to import csv file that have 6800000 observation

aanan1417 — Tue, 21 Dec 2021 15:44:57 GMT

i was trying to import csv file that have 6800000 observation but when i import csv file in sas i got 2800000

observation only

Re: trying to import csv file that have 6800000 observation

andreas_lds — Tue, 21 Dec 2021 15:52:22 GMT

Please post the code that you are using. Are there any unexpected messages in the log?

Re: trying to import csv file that have 6800000 observation

aanan1417 — Tue, 21 Dec 2021 15:58:04 GMT

i got a massage in the log that 2800000 observation imported ..

i try to do it by clicking on proc import then next after that i select the variable then i click next

Re: trying to import csv file that have 6800000 observation

Tom — Tue, 21 Dec 2021 16:03:02 GMT

@aanan1417 wrote:

i was trying to import csv file that have 6800000 observation but when i import csv file in sas i got 2800000

observation only

That is too large a file to trust to PROC IMPORT.

Instead of "importing" the file just write a data step that will read the file.

How many variables are there? How do you want them defined? Does the file have a header line with suggested names for the variables?

To look at the beginning of the file use a simple data step. Use the OBS= option on the INFILE statement to limit the number of lines read. Use a bare INPUT statement to read the lines. Use the LIST statement to display the lines.

data _null_;
  infile 'myfile.csv' obs=5 ;
  input;
  list;
run;

Re: trying to import csv file that have 6800000 observation

Tom — Tue, 21 Dec 2021 16:05:31 GMT

Are you running on Windows? Perhaps the file contains the DOS end of file character?

Use the IGNOREDOSEOF option on the INFILE statement.