topic Re: How to import all observations from an one record infile (@@ is not enougth) in SAS Enterprise Guide

How to import all observations from an one record infile (@@ is not enougth)

TanaraRose — Tue, 17 Mar 2015 20:04:34 GMT

Hi,

I have a txt file with all my observation in just one record, similiar to this:

[{"Var1":"a1234","Var2":"a567","var3":0,"var4":0},{"Var1":"b1234","Var2":"b567","var3":1,"var4":0},{"Var1":"c1234","Var2":"c567","var3":0,"var4":0}, ..............................................]

I'm trying to import its content to a dataset. But even using double trailing I just end up with 2 observations (the txt file has something about 20,000 observations). This is the code:

data dataset1;

infile '/local/arquivo_1.txt' dlm='{[,:"} ;';

input var1 $ Var1_content : $9. var2 : $12. Var2_content : $12. var3 : $16. Var3_content $ var4 : $12. Var4_content $ @@;

run;

Re: How to import all observations from an one record infile (@@ is not enougth)

Tom — Tue, 17 Mar 2015 20:59:01 GMT

Add a LRECL option to the INFILE statement. You should be able to set it to a billion (1 with 9 zeros).

If that doesn't work then read the file using STREAM input and convert all of the '}' to '0A'x and then the line lengths will be shorter.

Re: How to import all observations from an one record infile (@@ is not enougth)

ballardw — Tue, 17 Mar 2015 21:57:50 GMT

If this was a one-time project I would be very tempted to use and editor to replace the string },

with }<new line> where new line is the appropriate one for your OS.

Re: How to import all observations from an one record infile (@@ is not enougth)

Peter_C — Tue, 17 Mar 2015 22:50:29 GMT

data dataset1;

infile '/local/arquivo_1.txt' dlm='{[,:"} ;';

length varn varn_conts $20 ;

Do case = 1 by 1 ;

input varn Varn_conts @ ;

If varn = " " then input ;

Else output ;

End ;

stop ;

run;

Re: How to import all observations from an one record infile (@@ is not enougth)

Reeza — Wed, 18 Mar 2015 02:32:50 GMT

Is the original file JSON?

Re: How to import all observations from an one record infile (@@ is not enougth)

Ksharp — Wed, 18 Mar 2015 13:23:41 GMT

It is JSON file which is a stream file , You need to tell SAS it is a stream file by defining recfm=n ;

data dataset1;

infile '/local/arquivo_1.txt' dlm='{[,:"} ;' recfm=n ;

input var1 $ Var1_content : $9. var2 : $12. Var2_content : $12. var3 : $16. Var3_content $ var4 : $12. Var4_content $ @@;

run;

Xia Keshan

Re: How to import all observations from an one record infile (@@ is not enougth)

TanaraRose — Wed, 18 Mar 2015 14:43:04 GMT

Thank you very much Tom! It worked perfectly