The SAS Output Delivery System and reporting techniques

size/memory limits in vmware fusion or other virtualization environments? 9GB

Accepted Solution Solved
Reply
Occasional Contributor
Posts: 5
Accepted Solution

size/memory limits in vmware fusion or other virtualization environments? 9GB

I have a 9 GB file I'm trying to run analysis on. SAS Studio fails after reading about 2 million observations.  There must be a way to adjust the settings in SAS or the virtualization environment (I'm using VMWARE fusion).  Any ideas?  We're on a deadline...thanks!


Accepted Solutions
Solution
‎09-28-2014 07:19 PM
Super User
Posts: 3,110

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Your log suggests you have run out of disk space not memory. Where is your WORK library pointing to? If it is your hard drive check how much free space you have.

View solution in original post


All Replies
Super User
Posts: 3,110

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Can you post the SAS error messages? Usually the SAS option MEMSIZE is the first one to look at. You can find out what the setting for this is using PROC OPTIONS. In our SAS environment, which also runs on VMWARE, we have MEMSIZE set to 2G (2 GByte)

Occasional Contributor
Posts: 5

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

will try  the memory settings. Meanwhile here are the messages:


biobased=0 BPAfree=0 earthkeeper=0 lyocell=0 PVCfree=0 eco=0 solar=0 MetaCert=0 MetaKW=0 MetaMod=. _ERROR_=1 _N_=20

ERROR: Insufficient space in file WORK.EBAYDATA.DATA.

ERROR: File WORK.EBAYDATA.DATA is damaged. I/O processing did not complete.

NOTE: 2169773 records were read from the infile '/folders/myfolders/1301.tsv'.

       The minimum record length was 246.

       The maximum record length was 622.

NOTE: SAS went to a new line when INPUT statement reached past the end of a line.

NOTE: Missing values were generated as a result of performing an operation on missing values.

       Each place is given by: (Number of times) at (Line)Smiley SadColumn).

       821 at 92:21        3 at 101:77         4 at 101:86         606 at 101:92       2168125 at 103:26  

NOTE: The SAS System stopped processing this step because of errors.

WARNING: The data set WORK.EBAYDATA may be incomplete.  When this step was stopped there were 2168946 observations and 137

          variables.

WARNING: Data set WORK.EBAYDATA was not replaced because this step was stopped.

NOTE: DATA statement used (Total process time):

       real time           33.16 seconds

       cpu time            32.94 seconds

Occasional Contributor
Posts: 5

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

SAS Studio Proc Options does not seem to allow the MEMSIZE option

Occasional Contributor
Posts: 7

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

How do you adjust the settings. I too run out of work space. And I'm also running the Virtual box on a Mac
Super User
Posts: 17,842

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

What version of SAS are you on exactly? Analytics version or the Academic?

Occasional Contributor
Posts: 5

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

SAS University Edition Releas 3.1 operating within VMWARE Fusion.

Super User
Posts: 17,842

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Pretty sure that is a 2GB VM that cannot be changed. It is intended for learning purposes so that makes some sense. 

Solution
‎09-28-2014 07:19 PM
Super User
Posts: 3,110

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Your log suggests you have run out of disk space not memory. Where is your WORK library pointing to? If it is your hard drive check how much free space you have.

Occasional Contributor
Posts: 5

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

That was it. I guess the disk in the virtual machine was too small. once i figured out a libname pointing to an external file the problem was solved.

thank you!

New Contributor
Posts: 2

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Hi,

I was just reading your thread. I too have "ERROR: Insufficient space in file".

How did you fix it exactly? I am used to the SAS 9.4 but not the virtual environment SAS. I keep reading about redirecting the WORK folder to a physical location, but I am not tech savvy enough to understand how to do that exactly. I am using Oracle VM Virtualbox.

Thank you!

-M

Super User
Posts: 9,682

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

add  OPTIONS USER='/folders/myfold/';    before your code which will re-direct WORK library to /folders/myfold/  .

New Contributor
Posts: 2

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Thank you very much!

I will try it ASAP.

Regards,

M

☑ This topic is SOLVED.

Need further help from the community? Please ask a new question.

Discussion stats
  • 12 replies
  • 1876 views
  • 0 likes
  • 6 in conversation