I have a Time Series (ARIMA) model in SAS, modelled using proc ARIMA which I am trying to replicate in SAS Forecasting Studio. What I see is that The parameter estimates in both are very similar (which is surprising, since my colleagues haven't had such luck, but I digress), but the MAPEs calculated with a Holdout of 7 months does not match. I would understand the parameters not matching, with the numerical optimization algorithms giving different results with different initial values, but the MAPEs not matching is very puzzling. Has anyone else here come across this, or has any idea what might be the case? DO you need any more information to address this issue?
Different to PROC ARIMA SAS Forecast Studio supports both concepts of hold-out sample and out-of-sample data. In a nutshell: hold-out sample data are used during the model selection process, out-of-sample data are not.
I presented at SAS Global Forum 2009 some slides, which may help to explain the 2 concepts in more detail (http://support.sas.com/resources/papers/proceedings09/316-2009.pdf). Of course you will find similar information in SAS Forecast Server documentation.
PROC ARIMA only supports out-of-sample data using the BACK option - so you will need to make sure to compare similar statistics.
If in doubt please contact Techical Support for some guidance.
HI Udo - Thank you for your helpful comments!
I guess I have covered my questions on the back= option in another post so will not duplicate it here.
The link you provided has only the abstract of the talk... could you please guide me to the full presentation? That would be very helpful!
Many Thanks again!
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.
Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.
Find more tutorials on the SAS Users YouTube channel.