topic Re: PC Ram usage cap at 7.8 Gig in SAS Programming

PC Ram usage cap at 7.8 Gig

hhchenfx — Mon, 26 Feb 2018 22:33:59 GMT

Hello Everyone,

I have SAS at home and SAS in my office (university).

For the same procedure, My home PC use 30 Gig Ram while The office PC just FLAT at 7.8 Gig!

It takes way to long time to complete the process.

Is there any way I can fix this problem?

I try to copy the config file from home PC to office PC but still doesn't work.

Might be I miss something.

Any help please?

HHCFX

Re: PC Ram usage cap at 7.8 Gig

Reeza — Tue, 27 Feb 2018 00:53:48 GMT

How much physical RAM does your work PC have?

@hhchenfx wrote:

Hello Everyone,

I have SAS at home and SAS in my office (university).

For the same procedure, My home PC use 30 Gig Ram while The office PC just FLAT at 7.8 Gig!

It takes way to long time to complete the process.

Is there any way I can fix this problem?

I try to copy the config file from home PC to office PC but still doesn't work.

Might be I miss something.

Any help please?

HHCFX

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Tue, 27 Feb 2018 15:55:33 GMT

Both of my PC have the same config.

SSD with 70GB free storage

32 G Ram

i7 4770

Re: PC Ram usage cap at 7.8 Gig

Satish_Parida — Tue, 27 Feb 2018 17:51:17 GMT

Can you check your CPU utilization and Memory usage during process run and post it.
Heavy loads take time.

Re: PC Ram usage cap at 7.8 Gig

Reeza — Tue, 27 Feb 2018 17:52:21 GMT

Are they both running directly off the C drive, or is your work computer reading/writing from data on a network drive?

Is memsize the same on both machines.

You'll probably get faster answers from Tech Support.

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Tue, 27 Feb 2018 21:59:01 GMT

This is the screen short for 2 PC running the same procedure.

Re: PC Ram usage cap at 7.8 Gig

ChrisNZ — Wed, 28 Feb 2018 01:19:54 GMT

Microsoft-format documents are best avoided as they are unsafe.

There is no reason whatsoever they should be used to share images.

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Wed, 28 Feb 2018 01:45:14 GMT

I cant upload the screen short directly here.

SAS communities should allow us to share picture file.

Re: PC Ram usage cap at 7.8 Gig

Reeza — Wed, 28 Feb 2018 01:48:23 GMT

You can, you embed it using photos.

Screenshot A:

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Wed, 28 Feb 2018 02:53:10 GMT

Thank you,

Below is the screen short for the 2 PC.

Re: PC Ram usage cap at 7.8 Gig

Reeza — Wed, 28 Feb 2018 03:00:14 GMT

Just to confirm again (no answer), both were running directly off the C drive/work space, not a directory, correct? I can see that you definitely have a libname assigned in one, but not the other.

Assuming exact same hardware, settings (memsize), and config files, directory access, I would then start looking at what else is happening at the same time on your machines. Maybe something else is doing something to affect your processes or at least show the memory jump, ie does one have a security scan that has to happen or something along those lines.

Are those graphs for your overall computer or the SAS process alone?

Re: PC Ram usage cap at 7.8 Gig

ChrisNZ — Wed, 28 Feb 2018 03:01:17 GMT

It looks like your (just a few seconds) faster sort might be using an internal (RAM-based) sort while the other sort uses external (disk-based) sort. If so, the value of option SORTSIZE is the reason.

Please show the values of SORTSIZE, REALMEMSIZE and MEMSIZE.

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Wed, 28 Feb 2018 03:04:06 GMT

Both get file copy to C drive and copy to Work Lib. Both Run the same thing and nothing else running. Today, I copy the SAS Config file from home to office and nothing improve.
I heard that University SAS has limit on Ram usage (?) not sure it is the reason or not.

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Wed, 28 Feb 2018 03:06:49 GMT

I try this one:

/* File I/O */

-BUFNO 200
-BUFSIZE 64K
-UBUFSIZE 64K
-UBUFNO 20
-IBUFNO 64
-IBUFSIZE MAX
-CBUFNO MAX
-tbufsize 512k
-catcache max

AND TRY THAT ORIGINAL (same original setting) below

-WORK "!TEMP\SAS Temporary Files"
-MEMSIZE 2G
-SORTSIZE 256M

Basically the same thing happen.

Re: PC Ram usage cap at 7.8 Gig

Reeza — Wed, 28 Feb 2018 03:07:02 GMT

You're using SAS UE? There is no RAM limit, there's a limit on the number of cores you can have though.

How did you even change the config file on SAS UE, I didn't think you could. What do your VM settings show for each? Can you include screenshots of that?

It looks like you have a few steps in your code, so I guess I would also ask, which step is taking longer, because it's likely not all. The type of task will help pinpoint where the differences are. My laptop for example has an SSD whereas my desktop has a FusionDrive which is about half the speed.

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Wed, 28 Feb 2018 03:14:24 GMT

So the code is for stress test purpose.

Data combine_file; set big big big big; run;

proc sort data=combine_file by decending .....; run;

On the screen short, you can see that the Data step take 31/19 second for home and 1:31/24.80 for Office.

Sort: home 36 second/32 second office:41/34

First number if Real time, second number is Cpu time.

Most difference come from Data step. So weird that Cpu time for office only 24 but then realtime turn to be 1:31.

SAS UE is University edition? if so the answer is Yes.

VM settings is Virtual machine or what? My sas are on real machine.

Re: PC Ram usage cap at 7.8 Gig

Reeza — Wed, 28 Feb 2018 03:17:08 GMT

If it's University Edition it's on a virtual machine, using Oracle VirtualBox or is it a purchased copy from your University which is a different version, I think that's usually referred to as an Academic License but I could be wrong on that. Since you're referring to changing the config file you're likely using an academic license if you can modify the config file.

I can't see the timings in your screenshots, they're way too small for me to read.

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Wed, 28 Feb 2018 03:20:04 GMT

SLOWFAST

Re: PC Ram usage cap at 7.8 Gig

ChrisNZ — Wed, 28 Feb 2018 03:30:40 GMT

This thread is so confusing.

What was running when you had the circled ram usage? the data step or the proc sort?

It looks like it was the sort since the sort code is highlighted.

How are we then supposed to comment on the data step?

Also I notice that the "idle "memory usage is 3GB on one side, and 9GB on the other. Not the same config at all.

Please run proc options group=memory;run; on both machines and post the result.

Re: PC Ram usage cap at 7.8 Gig

hhchenfx — Wed, 28 Feb 2018 03:39:16 GMT

The slow one:

Group=MEMORY
SORTSIZE=268435456
Size parameter for sort
SUMSIZE=0 Upper limit for data-dependent memory usage during summarization
MAXMEMQUERY=0 Maximum amount of memory returned when inquiring as to available space
MEMBLKSZ=16777216 Size of memory blocks allocated to support MEMLIB and MEMCACHE options.
MEMMAXSZ=2147483648
Maximum amount of memory allocated to support MEMLIB and MEMCACHE options.
LOADMEMSIZE=0 Suggested memory limit for loaded SAS executables
MEMSIZE=2147483648
Specifies the limit on the total amount of memory to be used by the SAS
System
REALMEMSIZE=0 Limit on the total amount of real memory to be used by the SAS System
NOTE: PROCEDURE OPTIONS used (Total process time):
real time 0.00 seconds
cpu time 0.01 seconds

Fast one

It seems there is no difference at all.