size/memory limits in vmware fusion or other virtualization environments? 9GB

[gelobter]

I have a 9 GB file I'm trying to run analysis on. SAS Studio fails after reading about 2 million observations.  There must be a way to adjust the settings in SAS or the virtualization environment (I'm using VMWARE fusion).  Any ideas?  We're on a deadline...thanks!

[SASKiwi]

Can you post the SAS error messages? Usually the SAS option MEMSIZE is the first one to look at. You can find out what the setting for this is using PROC OPTIONS. In our SAS environment, which also runs on VMWARE, we have MEMSIZE set to 2G (2 GByte)

[gelobter]

will try  the memory settings. Meanwhile here are the messages:

biobased=0 BPAfree=0 earthkeeper=0 lyocell=0 PVCfree=0 eco=0 solar=0 MetaCert=0 MetaKW=0 MetaMod=. _ERROR_=1 _N_=20

ERROR: Insufficient space in file WORK.EBAYDATA.DATA.

ERROR: File WORK.EBAYDATA.DATA is damaged. I/O processing did not complete.

NOTE: 2169773 records were read from the infile '/folders/myfolders/1301.tsv'.

       The minimum record length was 246.

       The maximum record length was 622.

NOTE: SAS went to a new line when INPUT statement reached past the end of a line.

NOTE: Missing values were generated as a result of performing an operation on missing values.

       Each place is given by: (Number of times) at (Line):(Column).

       821 at 92:21        3 at 101:77         4 at 101:86         606 at 101:92       2168125 at 103:26  

NOTE: The SAS System stopped processing this step because of errors.

WARNING: The data set WORK.EBAYDATA may be incomplete.  When this step was stopped there were 2168946 observations and 137

          variables.

WARNING: Data set WORK.EBAYDATA was not replaced because this step was stopped.

NOTE: DATA statement used (Total process time):

       real time           33.16 seconds

       cpu time            32.94 seconds

[gelobter]

SAS Studio Proc Options does not seem to allow the MEMSIZE option

[Bill-D]

How do you adjust the settings. I too run out of work space. And I'm also running the Virtual box on a Mac

[Reeza]

What version of SAS are you on exactly? Analytics version or the Academic?

[gelobter]

SAS University Edition Releas 3.1 operating within VMWARE Fusion.

[Reeza]

Pretty sure that is a 2GB VM that cannot be changed. It is intended for learning purposes so that makes some sense. 

[SASKiwi · Accepted solution]

Your log suggests you have run out of disk space not memory. Where is your WORK library pointing to? If it is your hard drive check how much free space you have.

[gelobter]

That was it. I guess the disk in the virtual machine was too small. once i figured out a libname pointing to an external file the problem was solved.

thank you!

[MoSaidan]

Hi,

I was just reading your thread. I too have "ERROR: Insufficient space in file".

How did you fix it exactly? I am used to the SAS 9.4 but not the virtual environment SAS. I keep reading about redirecting the WORK folder to a physical location, but I am not tech savvy enough to understand how to do that exactly. I am using Oracle VM Virtualbox.

Thank you!

-M

[Ksharp]

add  OPTIONS USER='/folders/myfold/';    before your code which will re-direct WORK library to /folders/myfold/  .

[MoSaidan]

Thank you very much!

I will try it ASAP.

Regards,

M