Help using Base SAS procedures

obtain performance metrics for proc plm

Accepted Solution Solved
Reply
Frequent Contributor
Posts: 110
Accepted Solution

obtain performance metrics for proc plm

This code:

 

proc plm restore=SomeLib.ModelParams;
	score data=SomeLib.TestData out=SomeLib.Predictions;  
run;

produces the dataset SomeLib.Predictions which contains the predictions of the model against the dataset SomeLib.TestData.

 

Just wondering, can I use proc plm to obtain performance metrics such as:

 

Root MSE
Dependent Mean
R-Square
Adj R-Sq
AIC
AICC
SBC
ASE


Accepted Solutions
Solution
‎01-05-2017 07:36 AM
SAS Super FREQ
Posts: 3,755

Re: obtain performance metrics for proc plm

[ Edited ]
Posted in reply to csetzkorn

Not really. Those statistics have to do with evaluating the suitability of the model fit, so they come out of the regression procedures. They don't change after the model is fit. In contrast, PROC PLM is intended for for post-fitting analyses (after you have settled on a model) such as scoring new data or testing for treatment differences.

 

PROC PLM does provide some model statistics if you use the SHOW statement. For example, you can submit SHOW FITSTATS, which provides the MSE and ErrorDF statistics. So you can get figure out the RMSE. But I don't see an easy way to get AIC, BIC, etc

 

View solution in original post


All Replies
Solution
‎01-05-2017 07:36 AM
SAS Super FREQ
Posts: 3,755

Re: obtain performance metrics for proc plm

[ Edited ]
Posted in reply to csetzkorn

Not really. Those statistics have to do with evaluating the suitability of the model fit, so they come out of the regression procedures. They don't change after the model is fit. In contrast, PROC PLM is intended for for post-fitting analyses (after you have settled on a model) such as scoring new data or testing for treatment differences.

 

PROC PLM does provide some model statistics if you use the SHOW statement. For example, you can submit SHOW FITSTATS, which provides the MSE and ErrorDF statistics. So you can get figure out the RMSE. But I don't see an easy way to get AIC, BIC, etc

 

Frequent Contributor
Posts: 110

Re: obtain performance metrics for proc plm

Thanks but they change when I apply the model to new data (e.g. to assess when the model start to diverge - e.g. adjusted R squared decreases). I will take a look at SHOW.
☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 2 replies
  • 187 views
  • 0 likes
  • 2 in conversation