topic Re: Need to unzip an xpt file which size is 1gig+ in New SAS User

Need to unzip an xpt file which size is 1gig+

aaditawhid — Fri, 10 Nov 2023 20:13:23 GMT

Hi, I dont know too much about SAS, I am using cloud SAS Studio, I want to unzip an an XPT file which is more than 1 gig. Firstly i tried to unzip that xpt file to local drive, when i wanted to impot that file to SAS Studio, Msg come that more then 1gb size file could not be imported, So imported the zip file. then i tried following code,

filename inzip ZIP "/home/u63672513/Mydata/LLCP2022XPT.zip";

/* Read the "members" (files) from the ZIP file */
data contents(keep=memname isFolder);
length memname $200 isFolder 8;
fid=dopen("inzip");
if fid=0 then
stop;
memcount=dnum(fid);
do i=1 to memcount;
memname=dread(fid,i);
/* check for trailing / in folder name */
isFolder = (first(reverse(trim(memname)))='/');
output;
end;
rc=dclose(fid);
run;

/* create a report of the ZIP contents */
title "Files in the ZIP file";
proc print data=contents noobs N;
run;

Now i can see the XPT file in the work folder "/saswork/SAS_work39CD0001A26A_odaws02-apse1.oda.sas.com/SAS_work59200001A26A_odaws02-apse1.oda.sas.com",

Now i want to copy the XPT file to the folder (/home/u63672513/Mydata), need expert help, please

Re: Need to unzip an xpt file which size is 1gig+

Reeza — Fri, 10 Nov 2023 20:33:13 GMT

Looks like you have the first part of this blog post followed, but not the second part about copying the file out. In the post they're using a WORK library to copy it out, but you should use a local folder, so change the 'xl' reference in the code to the location you want to save the file.

https://blogs.sas.com/content/sasdummy/2015/05/11/using-filename-zip-to-unzip-and-read-data-files-in-sas/

Maybe something like this:

/* identify a temp folder in the WORK directory */
filename xl "/home/USERNAME/....../LLCP2022XPT.xpt" ;
 
/* hat tip: "data _null_" on SAS-L */
data _null_;
   /* using member syntax here */
   infile inzip(LLCP2022XPT.xpt) 
       lrecl=256 recfm=F length=length eof=eof unbuf;
   file   xl lrecl=256 recfm=N;
   input;
   put _infile_ $varying256. length;
   return;
 eof:
   stop;
run;

Also, if the file is located in the cloud or public then you can download it using proc https.

Re: Need to unzip an xpt file which size is 1gig+

aaditawhid — Fri, 10 Nov 2023 21:06:42 GMT

Thanks Reeza, But as i told i am very new, so i could understand, but also tried the 2nd part but rcvd error. I used your above code that is generating and LLCP2022.XPT with 0 byte. here is my file. please advise

Re: Need to unzip an xpt file which size is 1gig+

Reeza — Fri, 10 Nov 2023 21:25:19 GMT

A screenshot isn't helpful, you should include the log.

Here's a full example of the code. Make the changes to your code appropriately. If you have issues, include your LOG.

*path to the zip file;
filename src zip "/home/fkhurshed/Demo2/P_DR2IFF.zip";

*path to where to save the xpt file;
filename xl "/home/fkhurshed/Demo2/P_DR2IFF.xpt" ;
 
*extract file from zip - P_DR2IFF.XPT in the code below is the name of the file in the zipped file that is to be extracted;
data _null_;
   /* using member syntax here */
   infile src(P_DR2IFF.XPT) 
       lrecl=256 recfm=F length=length eof=eof unbuf;
   file   xl lrecl=256 recfm=N;
   input;
   put _infile_ $varying256. length;
   return;
 eof:
   stop;
run;

*where to store the SAS dataset;
libname projfile '/home/fkhurshed/Demo2/';

*XPT file (same as filename xl as above);
libname xptfile xport '/home/fkhurshed/Demo2/P_DR2IFF.xpt' access=readonly;

*extract the SAS dataset from the XPT file;
proc copy inlib=xptfile outlib=projfile;
run;

Re: Need to unzip an xpt file which size is 1gig+

Tom — Sat, 11 Nov 2023 17:34:39 GMT

What kind of XPT file is it?

Is it a SAS V5 XPORT file (made with the XPORT libref engine)?

Is it a SAS V9 XPORT file (made with the autocall macro %LOC2XPT)?

Is it a CPORT file (made with PROC CPORT)?

You can use this macro to detect the filetype.

https://github.com/sasutils/macros/blob/master/xpttype.sas

Re: Need to unzip an xpt file which size is 1gig+

aaditawhid — Sat, 11 Nov 2023 04:31:31 GMT

1 OPTIONS NONOTES NOSTIMER NOSOURCE NOSYNTAXCHECK;

69 *path to the zip file;

70 filename src zip "/home/u63672513/Mydata/LLCP2022XPT.zip";

72 *path to where to save the xpt file;

73 filename xl "/home/u63672513/Mydata/LLCP2022.xpt" ;

75 *extract file from zip - P_DR2IFF.XPT in the code below is the name of the file in the zipped file that is to be

75 ! extracted;

76 data _null_;

77 /* using member syntax here */

78 infile src(LLCP2022.xpt)

79 lrecl=256 recfm=F length=length eof=eof unbuf;

80 file xl lrecl=256 recfm=N;

81 input;

82 put _infile_ $varying256. length;

83 return;

84 eof:

85 stop;

86 run;

ERROR: Entry LLCP2022.xpt in zip file /home/u63672513/Mydata/LLCP2022XPT.zip does not exist.

ERROR: Physical file does not exist, LLCP2022.xpt.

NOTE: UNBUFFERED is the default with RECFM=N.

NOTE: The file XL is:

Filename=/home/u63672513/Mydata/LLCP2022.xpt,

Owner Name=u63672513,Group Name=oda,

Access Permission=-rw-r--r--,

Last Modified=11Nov2023:10:27:26

NOTE: The SAS System stopped processing this step because of errors.

NOTE: DATA statement used (Total process time):

real time 0.00 seconds

user cpu time 0.00 seconds

system cpu time 0.00 seconds

memory 553.87k

OS Memory 19616.00k

Timestamp 11/11/2023 04:27:26 AM

Step Count 24 Switch Count 0

Page Faults 0

Page Reclaims 150

Page Swaps 0

Voluntary Context Switches 9

Involuntary Context Switches 0

Block Input Operations 0

Block Output Operations 0

88 *where to store the SAS dataset;

89 libname projfile '/home/u63672513/Mydata';

NOTE: Libref PROJFILE refers to the same physical library as SASDATA1.

NOTE: Libref PROJFILE was successfully assigned as follows:

Engine: V9

Physical Name: /home/u63672513/Mydata

91 *XPT file (same as filename xl as above);

92 libname xptfile xport '/home/u63672513/Mydata/LLCP2022.xpt' access=readonly;

NOTE: Libref XPTFILE was successfully assigned as follows:

Engine: XPORT

Physical Name: /home/u63672513/Mydata/LLCP2022.xpt

94 *extract the SAS dataset from the XPT file;

95 proc copy inlib=xptfile outlib=projfile;

96 run;

NOTE: Input library XPTFILE is sequential.

WARNING: Input library XPTFILE is empty.

NOTE: PROCEDURE COPY used (Total process time):

real time 0.00 seconds

user cpu time 0.00 seconds

system cpu time 0.00 seconds

memory 589.40k

OS Memory 19876.00k

Timestamp 11/11/2023 04:27:26 AM

Step Count 25 Switch Count 0

Page Faults 0

Page Reclaims 107

Page Swaps 0

Voluntary Context Switches 2

Involuntary Context Switches 0

Block Input Operations 0

Block Output Operations 8

98 OPTIONS NONOTES NOSTIMER NOSOURCE NOSYNTAXCHECK;

108

Here is the log, please check

Re: Need to unzip an xpt file which size is 1gig+

aaditawhid — Sat, 11 Nov 2023 07:29:43 GMT

Hello Dear all, Very sorry, I am really new to SAS, I just need to get the XPT file from the zip file then i need it to convert in sas7bdat. But Due to file size (more then 1 gig) i can not import it from local PC

Re: Need to unzip an xpt file which size is 1gig+

Kurt_Bremser — Sat, 11 Nov 2023 10:08:49 GMT

Check this spelling:

"/home/u63672513/Mydata/LLCP2022XPT.zip"

It must be exactly how the path is named in the filesystem, particularly with regards to upper/lowercase. The UNIX system on which On Demand runs is case sensitive.

After uploading the zip file, right-click on it in the file navigation and copy the whole name from there.

Also make sure that the spelling of the xpt member in the zip archive is correct.

Re: Need to unzip an xpt file which size is 1gig+

Tom — Sat, 11 Nov 2023 15:02:40 GMT

The code shown here does not agree with the name you showed in the picture you posted before.

The code is using:

infile src(LLCP2022.xpt)

But the name that I read from the picture you posed is:

LLCP2022.XPT

Can you see the difference?

Wrong case on the letters in the extension.

Re: Need to unzip an xpt file which size is 1gig+

Tom — Sat, 11 Nov 2023 16:04:20 GMT

To see what type of file your "xpt" file is read the first 80 bytes.

data _null_;
  infile "/home/u63672513/Mydata/LLCP2022XPT.zip" zip
          member='*' lrecl=80 recfm=f obs=1;
  input;
  list;
run;

If the first line looks like:

**COMPRESSED** **COMPRESSED** **COMPRESSED** **COMPRESSED** **COMPRESSED********

Then your "xpt" file is a CPORT file and you will need to use PROC CIMPORT to read it.

If the first line looks like:

HEADER RECORD*******LIBRARY HEADER RECORD!!!!!!!000000000000000000000000000000

then you have a version 5 XPORT file and you can use the XPORT libref engine to read it.

If the fist line looks like

HEADER RECORD*******LIBV8   HEADER RECORD!!!!!!!000000000000000000000000000000

Then you have a version 9 XPORT file you will have to use the %XPT2LOC() macro to read it.

Re: Need to unzip an xpt file which size is 1gig+

Reeza — Tue, 14 Nov 2023 15:14:49 GMT

I believe it's case sensitive and XPT needs to be capitalized in the statement.

infile src(LLCP2022.xpt) lrecl=256 recfm=F length=length eof=eof unbuf;

Re: Need to unzip an xpt file which size is 1gig+

yabwon — Tue, 14 Nov 2023 15:31:34 GMT

How about using BasePlus package and the %unzipArch() macro to get content of that zip?

filename SPFinit url "https://bit.ly/SPFinit";
%include SPFinit; 


filename packages "/home/u63672513/packages"; /* create that directory*/
%installPackage(SPFinit BasePlus)
%loadPackage(BasePlus)

%unzipArch(
  LLCP2022XPT.zip 
, path = /home/u63672513/Mydata/
, target = /home/u63672513/Mydata/
, list=1
)

bart