Data set Damaged.

Reply
Occasional Contributor
Posts: 13

Data set Damaged.

Hello All,

 

We work on BASE SAS on Unix server and from past two days the Data set is being damaged frequently. Few times it is recovered by repaire statement with the loss of few records and the rest of the times it would say cannot be repaired.

This usually happens during the SET statement or Proc append statement and this is not perticular to table.

Below are my observations.

1. The tables are of huge size.

2. We have a good SAS work memory allocated. But not sure about the utilization and configuration files which impacts.

 

This is highly impacting our business, would be really helpful if you give some analysis steps or solution.

 

Regards,

Gokul Shivananda

Grand Advisor
Posts: 10,196

Re: Data set Damaged.

What do your Logs look like?

Any warnings or errors other than the damage?

Have you run any disk diagnostics? You may have hardware getting ready to fail.

Are any of the affected data sets used by multiple users or programs at the same time?

Occasional Contributor
Posts: 13

Re: Data set Damaged.

Hello Ballardw,

 

This is the error i got. No warnings, earlier.

 

MPRINT(_M_CREATE_CLAIM_CDS):   proc append base = APLEOPER.APL_OPR_CLM_DATA_AG data = WORK.F_OPR_CLM_DATA_EST force;
MPRINT(_M_CREATE_CLAIM_CDS):   run;

NOTE: Appending WORK.F_OPR_CLM_DATA_EST to APLEOPER.APL_OPR_CLM_DATA_AG.
ERROR: File APLEOPER.APL_OPR_CLM_DATA_AG.DATA is damaged. I/O processing did not complete.
NOTE: There were 33951 observations read from the data set WORK.F_OPR_CLM_DATA_EST.
NOTE: 33951 observations added.
NOTE: The data set APLEOPER.APL_OPR_CLM_DATA_AG has 926026 observations and 31 variables.
ERROR: File APLEOPER.APL_OPR_CLM_DATA_AG.DATA is damaged.
NOTE: Statements not processed because of errors noted above.
NOTE: PROCEDURE APPEND used (Total process time):
      real time           1.80 seconds

 

 

yes miltiple users use the same programme, but the table is used by one user.

 

i dont have idea about disk diagnostics. i shall reserch on this, please give inputs if you have any.

 

Thanks a lot.

 

Gokul Shivananda

Occasional Contributor
Posts: 13

Re: Data set Damaged.

Please find the attachment, hope this may help in finding the cause.

Thankyou.

Regards,

Gokul Shivananda

Grand Advisor
Posts: 17,313

Re: Data set Damaged.

Talking to SAS Tech Support is a good idea. 

Datasets of less than a million rows are not huge by any means, is that the correct size for the datasets listed in the log? 

 

Check your network for issues. If your having connectivity issues you may be having issues creating and saving files. 

And/or you may have a virus/ransom ware. 

Occasional Contributor
Posts: 13

Re: Data set Damaged.

Hello Guys,

 

Found the cause for this

proc append base = APLEOPER.APL_OPR_CLM_DATA_AG data = WORK.F_OPR_CLM_DATA_EST force;
run;

NOTE: Appending WORK.F_OPR_CLM_DATA_EST to APLEOPER.APL_OPR_CLM_DATA_AG.
ERROR: File APLEOPER.APL_OPR_CLM_DATA_AG.DATA is damaged. I/O processing did not complete

 

I just recreated Data table WORK.F_OPR_CLM_DATA_EST added the data. Now this works fine. i guess this was happening because data table WORK.F_OPR_CLM_DATA_EST might been corrupted.

 

Regards,

Gokul Shivananda

Respected Advisor
Posts: 3,060

Re: Data set Damaged.

In addition to @ballardw's valuable suggestions, talk to your server administrators and ask them to check the server event logs for any errors related to disks or IO controllers to help troubleshoot this problem. 

Occasional Contributor
Posts: 13

Re: Data set Damaged.

Hello SASKiwi,

 

Sure i shall check on this and let you know.

Thanks a lot.

 

regards,

Gokul Shivananda

Ask a Question
Discussion stats
  • 7 replies
  • 647 views
  • 0 likes
  • 4 in conversation