topic Reading Multiple observation per line into one column in SAS Programming

Reading Multiple observation per line into one column

rookie72 — Thu, 22 Mar 2012 17:25:13 GMT

Hi All,

I am trying to read a comma separatef flat file with following layout.

000000001687561, 000000001915561, 000000002877561, 000000004974561, 000000005703561, 000000006139561, 000000006594561, 000000006612561, 000000006806561, 000000007

108561, 000000007114561, 000000007581561, 000000007682561, 000000008259561, 000000008594561, 000000008864561, 000000009334561, 000000009840561, 000000010167561, 00

01333566192, 041501334051192, 041501340710192, 041501367218192, 041501462985192

I need to read this flat file in on column. Let us say.

obs id

1 000000001687561

2 000000001915561

3 000000002877561

4 ...

5 .....

I am having issue reading the last record of each line as it goes to next line to complete the record. I am using the following code. Is there better code for this? Can someone please help me out ?

data

test (drop=rec_no i);

Thanks !

infile "c:\aa.txt" dlm = ',' dsd missover

;

length id $ 15

;

retain rec_no 0

;

rec_no +

;

do i = 1 to 40

input

i $ @;

if i = ' ' then delete

;

output

;

end

;

run

;

Reading Multiple observation per line into one column

Astounding — Thu, 22 Mar 2012 17:31:56 GMT

rookie,

It's simpler than you might think. Try this:

data test;

infile "c:\aa.txt" dlm=',' dsd;

length id $ 15;

input id @@;

run;

Do NOT add MISSOVER when using @@.

Good luck.

Reading Multiple observation per line into one column

Astounding — Thu, 22 Mar 2012 17:38:48 GMT

Oops ... it's a little more complex because of the split records.

data test;

infile "c:\aa.txt" dlm=',' dsd;

length id $ 15;

input id @@;

last_id = lag(id);

if length(id)=15 then do;

output;

return;

end;

if length(id) + length(last_id) = 15 then do;

id = compress(last_id || id);

output;

end;

keep id;

run;

Sorry about that!

Reading Multiple observation per line into one column

rookie72 — Thu, 22 Mar 2012 19:07:47 GMT

Thank you very much I tired this code. It is reading only the first line of the raw data file. I will work on this code to make it work.

Reading Multiple observation per line into one column

Astounding — Thu, 22 Mar 2012 19:10:18 GMT

Did you remember to remove MISSOVER?

Reading Multiple observation per line into one column

rookie72 — Thu, 22 Mar 2012 19:16:30 GMT

Yes I did remove the MISSOVER from the code. Logically your code should work. But for some reason this is reading only the first line of the raw file.

Reading Multiple observation per line into one column

Astounding — Thu, 22 Mar 2012 19:48:45 GMT

OK, last guess. It's a little difficult to do this from afar.

Is it possible that there really is only one line of data? And that the tool you used to examine the raw data file split it into multiple lines for viewing purposes only?

That's easy enough to test. See how many lines get read in:

data _null_;

infile 'c:\aa.txt';

input id $ 1;

run;

Reading Multiple observation per line into one column

rookie72 — Thu, 22 Mar 2012 20:10:02 GMT

Indeed there was only one data line in the raw file. The view mode in the text editor was splitting the single dataline into many lines. Thank you for guiding me in the right direction. I really appreciate it !

Reading Multiple observation per line into one column

Tom — Thu, 22 Mar 2012 20:24:59 GMT

You might need to add LRECL option to the INFILE statement to prevent SAS from truncating the line. You should be able to tell from the messages in the SAS log.

Re: Reading Multiple observation per line into one column

Ksharp — Fri, 23 Mar 2012 04:30:31 GMT

recfm=n

data x;

infile 'c:\aa.txt' recfm=n dlm=',';

input x : $50. @@;

cards;

run;

Ksharp