SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

how to deal with Hash error "Hash object added 0 items when memory failure occurred." ?

Reply
Regular Contributor
Posts: 223

how to deal with Hash error "Hash object added 0 items when memory failure occurred." ?

Hi all,

 

    I am running a do loop and got into this hash error, wonder how can I deal with this error. please note I'm runing with SAS EG on linux server. (SAS EG is on my laptop)

    Detailed error info:

   

ERROR: Hash object added 0 items when memory failure occurred.

FATAL: Insufficient memory to execute DATA step program. Aborted during the EXECUTION phase.

ERROR: The SAS System stopped processing this step because of insufficient memory.

 

Possible solution I can think of:

1) Split big data set to small ones. I have total records about 3500000, it seems I need to split to at least 15 data sets. (I tested the small data set ran through the sas code successfully)

 

2) Increase the memory size?

I ran the code Proc Options group=memory; runand the results are as follows:

Group=MEMORY

SORTSIZE=1073741824

Specifies the amount of memory that is available to the SORT procedure.

SUMSIZE=0 Specifies a limit on the amount of memory that is available for data summarization procedures when class

variables are active.

MAXMEMQUERY=268435456

For certain procedures, specifies the maximum amount of memory that can be allocated per request.

LOADMEMSIZE=0 Specifies a suggested amount of memory that is needed for executable programs loaded by SAS.

MEMSIZE=2147483648

Specifies the limit on the amount of virtual memory that can be used during a SAS session.

REALMEMSIZE=0 Specifies the amount of real memory SAS can expect to allocate.

 

Please advise what I should do, any suggestion is welcome. Thank you!

Jade

 

 

 

  

   

 

Super User
Posts: 23,305

Re: how to deal with Hash error "Hash object added 0 items when memory failure occurred."

What are you trying to do with the hash? At 3.5 million records a plain sort/lookup may be better than a divide and conquer approach. 

Regular Contributor
Posts: 223

Re: how to deal with Hash error "Hash object added 0 items when memory failure occurred."

Thank you. I am use it for some do loop calculations. See details:

https://communities.sas.com/t5/SAS-Data-Management/how-to-come-up-with-a-do-loop-in-SAS-in-this-spec...

 

Ask a Question
Discussion stats
  • 2 replies
  • 460 views
  • 0 likes
  • 2 in conversation