BookmarkSubscribeRSS Feed
Xman
Calcite | Level 5

I have a Time Series (ARIMA) model in SAS, modelled using proc ARIMA which I am trying to replicate in SAS Forecasting Studio. What I see is that The parameter estimates in both are very similar (which is surprising, since my colleagues haven't had such luck, but I digress), but the MAPEs calculated with a Holdout of 7 months does not match. I would understand the parameters not matching, with the numerical optimization algorithms giving different results with different initial values, but the MAPEs not matching is very puzzling. Has anyone else here come across this, or has any idea what might be the case? DO you need any more information to address this issue?

Thanks, V

3 REPLIES 3
udo_sas
SAS Employee

Hello -

Different to PROC ARIMA SAS Forecast Studio supports both concepts of hold-out sample and out-of-sample data. In a nutshell: hold-out sample data are used during the model selection process, out-of-sample data are not.

I presented at SAS Global Forum 2009 some slides, which may help to explain the 2 concepts in more detail (http://support.sas.com/resources/papers/proceedings09/316-2009.pdf). Of course you will find similar information in SAS Forecast Server documentation.

PROC ARIMA only supports out-of-sample data using the BACK option - so you will need to make sure to compare similar statistics.

If in doubt please contact Techical Support for some guidance.

Thanks,

Udo

Xman
Calcite | Level 5

HI Udo - Thank you for your helpful comments!

I guess I have covered my questions on the back= option in another post so will not duplicate it here.

The link you provided has only the abstract of the talk... could you please guide me to the full presentation? That would be very helpful!

Many Thanks again!

Regards,

Xe

udo_sas
SAS Employee

Hello -

Yes, I should have done this before but I was fighting with the upload options of our communities.

Here you go.

Thanks,

Udo

sas-innovate-2024.png

 

Secure your spot at the must-attend AI and analytics event of 2024: SAS Innovate 2024! Get ready for a jam-packed agenda featuring workshops, super demos, breakout sessions, roundtables, inspiring keynotes and incredible networking events.

 

Register by March 1 to snag the Early Bird rate of just $695! Don't miss out on this exclusive offer. 

 

Register now!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 1982 views
  • 0 likes
  • 2 in conversation