topic Re: Double trailing Reading a long line in SAS Programming

Double trailing Reading a long line

athapa1183 — Tue, 28 Aug 2018 21:44:47 GMT

This is what i have

DATA B_1;
INFILE DATALINES ;
input x y @@;
datalines;
1 2 3 4 4 5 5 4
;

The row with the number 1 2 3 4 4 5 5 4 ....................... is very large . i just put a small numbers to make it easy.

This is what i want

X	Y
1	2
3	4
4	5
	5
4

Re: Double trailing Reading a long line

Reeza — Tue, 28 Aug 2018 21:49:36 GMT

Try adding the DSD option?

INFILE DATALINES  DSD;

@athapa1183 wrote:

This is what i have

DATA B_1;
INFILE DATALINES ;
@input x y @@;
datalines;
1 2 3 4 4 5 5 4
;

The row with the number 1 2 3 4 4 5 5 4 ....................... is very large . i just put a small numbers to make it easy.

This is what i want

X Y

1 2

3 4

4 5

5

4

Re: Double trailing Reading a long line

athapa1183 — Tue, 28 Aug 2018 21:51:36 GMT

DSD does not help.

417 DATA B_1;
418 INFILE DATALINES DSD;
419 input x y @@;
420 datalines;

NOTE: Invalid data for x in line 421 1-16.
NOTE: LOST CARD.
RULE: ----+----1----+----2----+----3----+----4----+----5----+----6----+----7----+----8----+--
422 ;
NOTE: Invalid data errors for file CARDS occurred outside the printed range.
NOTE: Increase available buffer lines with the INFILE n= option.
x=. y=. _ERROR_=1 _N_=1
NOTE: SAS went to a new line when INPUT statement reached past the end of a line.
NOTE: The data set WORK.B_1 has 0 observations and 2 variables.
NOTE: DATA statement used (Total process time):
real time 0.00 seconds
cpu time 0.01 seconds

422 ;

Re: Double trailing Reading a long line

ballardw — Tue, 28 Aug 2018 22:21:25 GMT

This gets the desired result:

DATA work.B_1;
INFILE DATALINES  ;
input x  y   @@;
datalines;
1 2 3 4 4 5 . 5 4 .
;
run;

A possibly somewhat random example such as this may not actually replicate your issue as datalines limit the use of certain options on the infile and change the behavior of others.

It might help to provide an actual line of the data pasted into a code box opened with the {I}.

It may also help to explicitly state that the issue seems to revolve around missing values at possibly random places in the actual data, if that is the case.

Re: Double trailing Reading a long line

Reeza — Tue, 28 Aug 2018 22:33:44 GMT

I specified the delimiter as well, but it has trouble determining the end of the data set then. For some reason it thinks it has 37 records now...

DATA B_1;
INFILE DATALINES dlm=' ' dsd;
input x y  @@;
datalines;
1 2 3 4 4 5  5 4
;
run;

Log:

16999 DATA B_1;
17000 INFILE DATALINES dlm=' ' dsd;
17001 input x y @@;
17002 datalines;

NOTE: LOST CARD.
RULE: ----+----1----+----2----+----3----+----4----+----5----+----6----+----7----+----8----+----9----+----0
17004 ;
x=. y=. _ERROR_=1 _N_=37
NOTE: SAS went to a new line when INPUT statement reached past the end of a line.
NOTE: The data set WORK.B_1 has 36 observations and 2 variables.
NOTE: DATA statement used (Total process time):
real time 0.00 seconds
cpu time 0.01 seconds

17004 ;
17005 run;

Re: Double trailing Reading a long line

ChrisNZ — Tue, 28 Aug 2018 22:48:19 GMT

So if there is no value value then there is simply nothing in the data?

The only way to spot the missing value is 2 spaces in a row?

Is it always just one digit?

Comment:

1. SAS will not accept a space as a missing numeric, so you need to read as character and parse

2. The exact code depends on your answers

Re: Double trailing Reading a long line

ballardw — Tue, 28 Aug 2018 22:50:19 GMT

@Reeza wrote:

I specified the delimiter as well, but it has trouble determining the end of the data set then. For some reason it thinks it has 37 records now...
DATA B_1;
INFILE DATALINES dlm=' ' dsd;
input x y  @@;
datalines;
1 2 3 4 4 5  5 4
;
run;
Log:

16999 DATA B_1;
17000 INFILE DATALINES dlm=' ' dsd;
@17001 input x y @@;
17002 datalines;

NOTE: LOST CARD.
RULE: ----+----1----+----2----+----3----+----4----+----5----+----6----+----7----+----8----+----9----+----0
17004 ;
x=. y=. _ERROR_=1 _N_=37
NOTE: SAS went to a new line when INPUT statement reached past the end of a line.
NOTE: The data set WORK.B_1 has 36 observations and 2 variables.
NOTE: DATA statement used (Total process time):
real time 0.00 seconds
cpu time 0.01 seconds

17004 ;
17005 run;

@Reeza

I think that is the datalines padding to 80 characters:

SAS handles data line length with the CARDIMAGE system option. If you use CARDIMAGE, SAS processes data lines exactly like 80–byte punched card images padded with blanks. If you use NOCARDIMAGE, SAS processes data lines longer than 80 columns in their entirety.

(but still pads lines less than 80 to 80 with the NOCARDIMAGE option)

Re: Double trailing Reading a long line

Tom — Tue, 28 Aug 2018 23:06:37 GMT

You are trying to read 10 values from a line that only has 9.

Perhaps you should first read all of the values first and then later you regroup them into observations?

Try something like this on your actual data an see if finds all of the values. Then you can worry about figuring out which as the X and which are the Y.

data want ;
  infile test dsd dlm=' ' ;
  row+1;
  input value @@ ;
run;

Obs    row    value

 1      1       1
 2      2       2
 3      3       3
 4      4       4
 5      5       4
 6      6       5
 7      7       .
 8      8       5
 9      9       4

Re: Double trailing Reading a long line

athapa1183 — Wed, 29 Aug 2018 13:28:19 GMT

Thank You Reeza. yes there are more rows. But it works

Re: Double trailing Reading a long line

athapa1183 — Wed, 29 Aug 2018 13:28:53 GMT

Hi Ballardw,

There are no dots here.

Re: Double trailing Reading a long line

athapa1183 — Wed, 29 Aug 2018 13:29:22 GMT

Thank You