topic Re: How can I import a txt file without delimiter in SAS Programming

How can I import a txt file without delimiter

JohanK — Wed, 18 Oct 2023 09:49:01 GMT

Dear reader, I am asking for help...

I am trying to import a TXT file with just text, but also ; : TAB etc..

I want to get the full file imported- just one variable, the file has 1861 rows but it only imports 20 of them

This is the code for importing:

PROC IMPORT DATAFILE="C:\Output\log.txt"
OUT=LOGFILE
DBMS=TAB REPLACE;
GETNAMES=NO;
RUN;

My LOG:

NOTE: WORK.LOGFILE data set was successfully created.
NOTE: The data set WORK.LOGFILE has 20 observations and 1 variables.
NOTE: PROCEDURE IMPORT used (Total process time):
real time 0.08 seconds
cpu time 0.04 seconds

Why are 20 lines imported and what can I best do?

I prefer PROC IMPORT...

Many thanks!

Re: How can I import a txt file without delimiter

PaigeMiller — Wed, 18 Oct 2023 10:04:17 GMT

PROC IMPORT is a guessing procedure. It guesses how the fields are separated, and in this case it guessed wrong.

You can read the data in a DATA step, where you use the INFILE statement with the DLM= option. The DLM= option allows you to specify more than one different delimiters that the file uses. https://documentation.sas.com/doc/en/pgmmvacdc/9.4/lestmtsref/n1rill4udj0tfun1fvce3j401plo.htm#n14rjz20kqjrgpn1jpffa0x4i9kl

In fact, PROC IMPORT will create (incorrect) code for you, look in the log. You should be able to modify the code so that the DATA step reads the data properly.

Re: How can I import a txt file without delimiter

ballardw — Wed, 18 Oct 2023 11:02:05 GMT

Why did you bother to attach that log? There is NO code that imports any txt file. Everything I see that calls proc import is for XLSX.

Unless asked only include log for pieces of code that you have a question about. Since there is nothing in that log with

PROC IMPORT DATAFILE="C:\Output\log.txt" it is useless. And the snippet that you show is not the complete log because if you use Proc Import with a Tab delimited file then there will be generated data step code.

Causes for fewer observations than you expect could be the file source uses a different end of line marker.

Which in a data step you use the INFILE statement to set the TERMSTR= option to see if that is the case. TERMSTR=CRLF for Windows source files, TERMSTR=LF for Unix Linux and derivitives and TERMSTR=CR for some other sources.

Re: How can I import a txt file without delimiter

Ksharp — Wed, 18 Oct 2023 12:02:06 GMT

You have EOF(end of file) character at 21th row, therefore sas stop reading file when running into it .

Add option IGNOREDOSEOF to ignore EOF character to read this fill all.

filename x "C:\temp\a\log.txt" termstr=crlf ignoredoseof;

PROC IMPORT DATAFILE=x
OUT=LOGFILE
DBMS=TAB REPLACE;
GETNAMES=NO;
guessingrows=max;
RUN;

Re: How can I import a txt file without delimiter

Ksharp — Wed, 18 Oct 2023 12:08:49 GMT

But I prefer to use data step ,that is simple and easy,if you only want ONE variable in dataset.

data x;
infile  "C:\temp\a\log.txt" termstr=crlf length=len ignoredoseof;
input x $varying1000. len;
run;

Re: How can I import a txt file without delimiter

Amir — Wed, 18 Oct 2023 12:15:19 GMT

Hi,

I'm not sure that I fully understand your requirement, there is mention of Tab characters in the data and that you only want one variable for the whole file, but Tab is in your proc import code too; maybe I'm missing something.

I see that you've said you prefer proc import, but as you are having problems with it, you can see if a data step alternative works for, e.g., as per the below untested code (you can change the log_record length if necessary):

data logfile;
  infile "C:\Output\log.txt" truncover;
  input log_record $char256.;
run;

Thanks & kind regards,

Amir.

Re: How can I import a txt file without delimiter

Tom — Wed, 18 Oct 2023 13:00:25 GMT

You don't need to IMPORT text files since SAS can just READ a text file.

The only reason to use PROC IMPORT to read a delimited file is if you want it to try to GUESS how to read it.

And if you don't have a delimited file there is nothing that it can GUESS for you.

So just read the file yourself with a DATA step.

Re: How can I import a txt file without delimiter

JohanK — Thu, 19 Oct 2023 05:21:32 GMT

Thank you so much Amir, it works !

Greetings, Johan

Re: How can I import a txt file without delimiter

JohanK — Thu, 19 Oct 2023 05:24:17 GMT

sorry, not Amir but Mr. Sharp...

Re: How can I import a txt file without delimiter

JohanK — Thu, 19 Oct 2023 05:25:30 GMT

Dear ballardw, I have a solution via another user. Many thanks though

Re: How can I import a txt file without delimiter

JohanK — Thu, 19 Oct 2023 05:26:17 GMT

Dear Paigemiller, many thanks for your reply. I have a solution via another user.

Re: How can I import a txt file without delimiter

JohanK — Thu, 19 Oct 2023 05:27:44 GMT

I have a solution via another user Tom, thanks for your reply!

Re: How can I import a txt file without delimiter

Kurt_Bremser — Thu, 19 Oct 2023 05:51:42 GMT

Read this log file with a DATA step and use the proper line termination string:

data log;
infile "log.txt" termstr=LF truncover;,
input line $256.;
run

LF is for text files originating from a UNIX environment. For Windows, use CRLF.