topic Re: size/memory limits in vmware fusion or other virtualization environments? 9GB in ODS and Base Reporting

size/memory limits in vmware fusion or other virtualization environments? 9GB

gelobter — Sun, 28 Sep 2014 21:06:08 GMT

I have a 9 GB file I'm trying to run analysis on. SAS Studio fails after reading about 2 million observations. There must be a way to adjust the settings in SAS or the virtualization environment (I'm using VMWARE fusion). Any ideas? We're on a deadline...thanks!

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

SASKiwi — Sun, 28 Sep 2014 21:18:57 GMT

Can you post the SAS error messages? Usually the SAS option MEMSIZE is the first one to look at. You can find out what the setting for this is using PROC OPTIONS. In our SAS environment, which also runs on VMWARE, we have MEMSIZE set to 2G (2 GByte)

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

gelobter — Sun, 28 Sep 2014 22:24:52 GMT

will try the memory settings. Meanwhile here are the messages:

biobased=0 BPAfree=0 earthkeeper=0 lyocell=0 PVCfree=0 eco=0 solar=0 MetaCert=0 MetaKW=0 MetaMod=. _ERROR_=1 _N_=20

ERROR: Insufficient space in file WORK.EBAYDATA.DATA.

ERROR: File WORK.EBAYDATA.DATA is damaged. I/O processing did not complete.

NOTE: 2169773 records were read from the infile '/folders/myfolders/1301.tsv'.

The minimum record length was 246.

The maximum record length was 622.

NOTE: SAS went to a new line when INPUT statement reached past the end of a line.

NOTE: Missing values were generated as a result of performing an operation on missing values.

Each place is given by: (Number of times) at (Line):(Column).

821 at 92:21 3 at 101:77 4 at 101:86 606 at 101:92 2168125 at 103:26

NOTE: The SAS System stopped processing this step because of errors.

WARNING: The data set WORK.EBAYDATA may be incomplete. When this step was stopped there were 2168946 observations and 137

variables.

WARNING: Data set WORK.EBAYDATA was not replaced because this step was stopped.

NOTE: DATA statement used (Total process time):

real time 33.16 seconds

cpu time 32.94 seconds

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

gelobter — Sun, 28 Sep 2014 22:28:50 GMT

SAS Studio Proc Options does not seem to allow the MEMSIZE option

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Reeza — Sun, 28 Sep 2014 22:50:18 GMT

What version of SAS are you on exactly? Analytics version or the Academic?

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

gelobter — Sun, 28 Sep 2014 22:51:54 GMT

SAS University Edition Releas 3.1 operating within VMWARE Fusion.

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Reeza — Sun, 28 Sep 2014 23:12:42 GMT

Pretty sure that is a 2GB VM that cannot be changed. It is intended for learning purposes so that makes some sense.

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

SASKiwi — Sun, 28 Sep 2014 23:19:07 GMT

Your log suggests you have run out of disk space not memory. Where is your WORK library pointing to? If it is your hard drive check how much free space you have.

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

gelobter — Sun, 28 Sep 2014 23:42:46 GMT

That was it. I guess the disk in the virtual machine was too small. once i figured out a libname pointing to an external file the problem was solved.

thank you!

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

MoSaidan — Sat, 02 May 2015 16:41:35 GMT

Hi,

I was just reading your thread. I too have "ERROR: Insufficient space in file".

How did you fix it exactly? I am used to the SAS 9.4 but not the virtual environment SAS. I keep reading about redirecting the WORK folder to a physical location, but I am not tech savvy enough to understand how to do that exactly. I am using Oracle VM Virtualbox.

Thank you!

-M

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Ksharp — Sun, 03 May 2015 12:27:34 GMT

add OPTIONS USER='/folders/myfold/'; before your code which will re-direct WORK library to /folders/myfold/ .

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

MoSaidan — Wed, 06 May 2015 09:00:11 GMT

Thank you very much!

I will try it ASAP.

Regards,

Re: size/memory limits in vmware fusion or other virtualization environments? 9GB

Bill-D — Tue, 25 Oct 2016 23:58:35 GMT

How do you adjust the settings. I too run out of work space. And I'm also running the Virtual box on a Mac