- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
I am attempting to join fairly large data sets (one is over 27 GB) and I keep encountering the following errors. I have successfully run this job in the past, but the slow buildup of data each month appears to have surpassed what my SAS EG is configured for.
ERROR: Insufficient space in file WORK.'SASTMP-000000061'.UTILITY.
ERROR: File WORK.'SASTMP-000000061'.UTILITY is damaged. I/O processing did not complete.
ERROR: There is not enough WORK disk space to store the results of an internal sorting phase.
ERROR: An error has occurred.
Based on other sources online, I was guided to increase my SORTSIZE and MEMSIZE on the SASv9 config file (I did so by a factor of 5 - certainly more than enough), but this has not resolved the issue. I found this official information from SAS on increasing allocated WORK space, but I do not know what these values mean and I want to be careful before running unknown code. Moreover, the page recommends checking your default WORK library size but does not provide any info on how to do that (nor does anywhere else online I could find). So my two questions are:
- How do I check my default WORK library size?
- What do the 500 and 1000 parameters mean in the code provided in the SAS support page?
To clear up some outstanding questions you may have, this is running on SAS 9.4 under Enterprise Guide 8.3.3.181. My source files are on my local disk, and I am writing to my local disk. I have checked my work directory in case there were large leftover files from previous jobs. I have also closed the SAS project and then opened and re-ran just this step to make sure my WORK directory is completely empty. I have executed select distinct on the join columns of all tables and found each returns with the same number of original rows (i.e. no duplicates can be generated). I have over 1 TB available on my local disk.
Thank you in advance!
- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
You are running out of space in your disk storage, so increasing memory parameters won't help.
Please post the complete log (all code and messages) of the failing step.
- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
I suggest you monitor your WORK disk usage while running this program by having Windows Explorer open on your local hard drive. What does this report regarding how much free space you have when you get these errors?
- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
Try adding the following option into SASV9.CFG .
-work "d:\temp\"
- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
Hello @Placeholder
If you are having files left over from the previous runs in the work directory then clean them using cleanwork utility. (https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/hostunx/n13ozwpq7az8v6n1s77r8c2zp9d1.htm)
As a general rule the size of the work directory is limited by the available space unless some of restrictions are placed by the OS Administrators.
The SAS support page you have referred (https://support.sas.com/kb/22/364.html) to pertains to Mainframe/z/os.
Are you running your code on a Z/OS machine?
.