topic Re: Importing a file with characters more than 32000 in SAS Programming

Importing a file with characters more than 32000

JT99 — Thu, 25 Jan 2024 06:52:24 GMT

Hello! I need to import a txt file with a column that exceeds 32000. This is a simplified version of my code. Sorry i’m using my phone since I can’t use my work laptop to login here.

%macro import(file)
Data file;
infile “/abc/defg/&file” truncover lrecl=32000;
input @1 banner $32000.;
data file;set file;
Enum=substr(banner,43,9);
Run;
%mend import;

How do I make banner spill to another column say banner2 if characters are more than 32000?

Re: Importing a file with characters more than 32000

LinusH — Thu, 25 Jan 2024 06:58:34 GMT

Without having tried, I would use a second input variable:

input @1 banner $32000. @32001 banner2 $32000.;

Re: Importing a file with characters more than 32000

yabwon — Thu, 25 Jan 2024 07:52:03 GMT

If there is more than 32k data in single line, you also probably want to increase the "lrecl=" to something bigger than 32k, e.g. "lrecl=1000000;"

Bart

Re: Importing a file with characters more than 32000

Patrick — Thu, 25 Jan 2024 13:21:09 GMT

IF you have access to a Viya 4 environment then you could load the .csv into a CAS table where you've got data type varchar(*) that can store more than 32KB characters.

Re: Importing a file with characters more than 32000

Tom — Thu, 25 Jan 2024 15:31:35 GMT

You don't seem to be "importing" anything. You appear to just want to READ a text file.

For example to read up to 5*32000 bytes from each line into 5 character variables just do something like this:

data want;
  infile 'myfile' lrecl=1000000 truncover;
  input (var1-var5) ($char32000.);
run;

If the lines are varying length it will probably save space and be easier to work with if you read the text into multiple observations.

data want;
  infile 'myfile' lrecl=1000000 length=ll colum=cc truncover;
  row+1;
  do col=1 by 1 until(cc>ll);
    input string $char32000. @;
    output;
  end;
run;