BookmarkSubscribeRSS Feed
alepage
Barite | Level 11

Hello,

 

I would like to know What's the maximum file size of a SAS dataset on a Unix server? I am receiving into my log file this error.

 

NOTE: Appending WORK.TABLE_INFO to WORK.FOUND_AGREEMENTS.
ERROR: Insufficient space in file WORK.FOUND_AGREEMENTS.DATA.
NOTE: There were 16720 observations read from the data set WORK.TABLE_INFO.
NOTE: 16719 observations added.
NOTE: The data set WORK.FOUND_AGREEMENTS has 56234190 observations and 23 variables.
ERROR: File WORK.FOUND_AGREEMENTS.DATA is damaged.
NOTE: Statements not processed because of errors noted above.
NOTE: PROCEDURE APPEND used (Total process time):
real time 2.15 seconds
cpu time 1.97 seconds

 

If I switch from base to spde engine, will it be better.

Which solution can I use ?

6 REPLIES 6
ballardw
Super User

I suggest checking with your SAS admin about the settings for your WORK library. I think you are more likely to run into an issue with admin settings limiting file space then the size of a data set.

alepage
Barite | Level 11

I have reviewed my SAS code and I found that I was reading spde files and appending those into a base file.  Could it be that ?

I have set libname dest1 spde "&path1". and appending base=dest1.found agreement . I hope it will works

 

Patrick
Opal | Level 21

There must be some quota on your WORK area. 

 

If you're one of these people who keep their SAS session alive "forever" then it's eventually just about some housekeeping. You could just start a new SAS session or you could within your existing session add a step that removes no more needed tables in work. Some code similar to below.

proc sql noprint;
  select memname into :memlist separated by ' '
  from dictionary.tables
  where libname='WORK' and memname not in ('TABLE_INFO','FOUND_AGREEMENTS')
  ;
quit;
proc datasets lib=work nolist nowarn;
  delete &memlist;
quit;
alepage
Barite | Level 11
does the drop statement will do the same:

proc sql;
drop table table_info;
quit;
Patrick
Opal | Level 21

@alepage wrote:
does the drop statement will do the same:

proc sql;
drop table table_info;
quit;

It does but you can only drop one table at a time and the table must exist.

With Proc Datasets NOWARN you can drop multiple tables at once and the command will also work should a table not exist. 

Ksharp
Super User
As Patrick and ballardw said your account has limited quota of disk storage , talk to your UNIX Admin to unlease your quote by command :
xfs_quota -x -c 'limit -u bsoft=80M bhard=100M username' /data

P.S: use command
quota username
to chek your quota.

hackathon24-white-horiz.png

The 2025 SAS Hackathon Kicks Off on June 11!

Watch the live Hackathon Kickoff to get all the essential information about the SAS Hackathon—including how to join, how to participate, and expert tips for success.

YouTube LinkedIn

Creating Custom Steps in SAS Studio

Check out this tutorial series to learn how to build your own steps in SAS Studio.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 6 replies
  • 1204 views
  • 5 likes
  • 4 in conversation