BookmarkSubscribeRSS Feed
deleted_user
Not applicable
I need read data from more than 10 big zipped SAS datasets, each of then is very big(15G), I can manually upzip them first but it is time consuming. I believe there must be a way to read the data without unzipping them. Who can help me with that?

The datasets are SAS data, e.g. client_200901.sas7bdat.gz. I tried Filename/Pipe/Zcat syntax but I failed.

Thank you very much for your help!
6 REPLIES 6
Doc_Duke
Rhodochrosite | Level 12
SAS Datasets are considered direct access or random access (terminology varies in different platforms), which is why the pipe approach fails (it is predicated on sequential access). You might be able to convert the SAS datasets into SAS transport files (a sequential version of a SAS dataset) and then read it with a pipe, but I'm not sure.

Some Unix file systems (Solaris 10, for example) support OS level data compression which has storage use very similar to gzip. If your OS supports it, you might be able to get your Unix Admin to set the entire file system for compression. (Windows compression works similarly, but it looks like you are on a Unix box.) This is transparent to the SAS program.
deleted_user
Not applicable
Yes I am on Unix box. Can you elaborate a little more detail on how I can do to read the compressed data?

Thanks again!
Peter_C
Rhodochrosite | Level 12
in windows explorer, a zip file can be displayed like a folder.
If the same effect could be achieved on that unix platform, perhaps a SAS libname statement could assign the zip file as a library using the sequential library engine
(but I'm not sure it even works in SAS on windows).

PeterC
Peter_C
Rhodochrosite | Level 12
sorry
this technique
libname thatz v9tape 'path\zipfile.zip' ;
* addressing the zip with sequential library engine;
doesn't work in windows (it even rejected the documented sequential library engines tape and v9tape)

ballot anyone? Message was edited by: Peter.C
Doc_Duke
Rhodochrosite | Level 12
Not much. Transport files use the XPORT engine. You'll have to take it from there.
deleted_user
Not applicable
Sorry, I found it hard to follow on how to do?

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 6 replies
  • 3095 views
  • 0 likes
  • 3 in conversation