BookmarkSubscribeRSS Feed
Xman
Calcite | Level 5

I have a Time Series (ARIMA) model in SAS, modelled using proc ARIMA which I am trying to replicate in SAS Forecasting Studio. What I see is that The parameter estimates in both are very similar (which is surprising, since my colleagues haven't had such luck, but I digress), but the MAPEs calculated with a Holdout of 7 months does not match. I would understand the parameters not matching, with the numerical optimization algorithms giving different results with different initial values, but the MAPEs not matching is very puzzling. Has anyone else here come across this, or has any idea what might be the case? DO you need any more information to address this issue?

Thanks, V

3 REPLIES 3
udo_sas
SAS Employee

Hello -

Different to PROC ARIMA SAS Forecast Studio supports both concepts of hold-out sample and out-of-sample data. In a nutshell: hold-out sample data are used during the model selection process, out-of-sample data are not.

I presented at SAS Global Forum 2009 some slides, which may help to explain the 2 concepts in more detail (http://support.sas.com/resources/papers/proceedings09/316-2009.pdf). Of course you will find similar information in SAS Forecast Server documentation.

PROC ARIMA only supports out-of-sample data using the BACK option - so you will need to make sure to compare similar statistics.

If in doubt please contact Techical Support for some guidance.

Thanks,

Udo

Xman
Calcite | Level 5

HI Udo - Thank you for your helpful comments!

I guess I have covered my questions on the back= option in another post so will not duplicate it here.

The link you provided has only the abstract of the talk... could you please guide me to the full presentation? That would be very helpful!

Many Thanks again!

Regards,

Xe

udo_sas
SAS Employee

Hello -

Yes, I should have done this before but I was fighting with the upload options of our communities.

Here you go.

Thanks,

Udo

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 2038 views
  • 0 likes
  • 2 in conversation