I am trying to open a large data set which is in a format .sas7bdat (1.2TB), but I am getting this error. It says ' Could not open the data file: File is damaged. I/O processing did not complete. How do I fix this error
What did you mean by open?
I'm not sure trying to view a 1.2TB file is a good idea. Take a subset and view that perhaps?
You can try repairing the dataset using proc datasets but if the file is damaged it may not be recoverable.
Proc datasets library=work nolist nodetails;
Repair brokenData;
Run;quit;
I wasn't aware that SAS ever had an limit. What is your SAS setup?
Is this a SAS dataset or a dataset on a server?
First off,I didn't know you could get a local machine with >1.2 TB hard disk space 🙂
Second, to get just a variable list, can you try this?
*****************************************************
data varlist;
set <library.datasetname> obs=1;
run;
proc contents data=varlist;
run;
*****************************************************
As for the SASV9.CFG file, you should look for it in your SAS s/w folder. Try C:\Program Files (x86)\SASFoundation\9.2\sasv9.cfg .. or something similar, once you get to the path, it musn't be difficult to find. Unfortunately, I don't have a local installation.
Check this article - http://support.sas.com/documentation/cdl/en/hostwin/63285/HTML/default/viewer.htm#a000104286.htm#wor... and search for 'SAS Default Folder Structure'. The default path is listed there.
Now once you find it, how you determine 'sufficient' space, I cannot say.
What type of analysis are you planning to do. The link you provided has some workarounds listed, have you tried them and they don't work.
If you take a sample you'll still get the list of variables and can develop your code. Any type of processing is going to take time...and space. Will you have enough space to work with the data, since you usually need 2-3 times the space to process the data.
You may want to contact tech support to get some help specifically for your situation.
I have seen similar when the machine on which I was working ran out of disk space when trying to open a large dataset.
You will need to find the drive on which your SAS work folder resides and check the available space.
To find out where it is check in your config file (SASV9.CFG) and look for the line starting -WORK.
If there is sufficient space then it could be insufficient memory.
HTH
Cheers
Chris
Hi
Sorry for delay in replying, been away from office.
You can find this information in previous messages if you search Communities but to save time:
1. Run proc options:
proc options option = config;
run;
2. Should give you something similar to below:
1 proc options option = config;
2 run;
SAS (r) Proprietary Software Release 9.1 TS1M3
CONFIG=C:\Program Files\SAS\SAS 9.1\nls\en\SASV9.CFG
Specifies a SAS configuration file.
NOTE: PROCEDURE OPTIONS used (Total process time):
real time 0.24 seconds
cpu time 0.00 seconds
3. Open up the config file specified.
4. Look for the line starting -WORK, as in the following example
/* DO NOT EDIT BELOW THIS LINE - INSTALL Application edits below this line */
/* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * */
-SET sasext0 "C:\Program Files\SAS\SAS 9.1"
-SET sasroot "C:\Program Files\SAS\SAS 9.1"
-SET sasext1 "C:\Program Files\SAS\SAS 9.1\nls"
/* Setup the MYSASFILES system variable */
-SET MYSASFILES "?CSIDL_PERSONAL\My SAS Files\9.1"
/* Setup the default SAS System user profile folder */
-SASUSER "?CSIDL_PERSONAL\My SAS Files\9.1"
/* Setup the default SAS System user work folder */
-WORK "!TEMP\SAS Temporary Files"
5. Navigate to the folder (if as above it shows !TEMP\... this will be your temporary files location e.g. C:\Documents and Settings\userid\Local Settings\Temp). The space available on the drive should be visible in the status bar at the bottom left of Windows Explorer. If there isn't enough space, you can specify a new work location following the instructions in SAS.
Cheers
Chris
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.