BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
jctran123
Calcite | Level 5

Hi SAS Community, 

 

I am working on a forecasting project and would really appreciate if someone could shed some light on model selection. I understand that SAS selects the best model based on the selection criteria. My selection criteria is MAPE and I noticed that when I create a custom model, my model's MAPE beats the "best" model that SAS selects. My question is, does SAS consider all model types before spitting out the "best" model or do they only consider the defaults (ARIMA and exponential smoothing)? 

 

My current project has selected ARIMA as the best model. Are there other reasons why ARIMA could have been chosen aside from having the "best" MAPE? 

 

Thank you,

 

Jessica  

1 ACCEPTED SOLUTION

Accepted Solutions
alexchien
Pyrite | Level 9

Hi Jessica,

Forecast Server uses an automatic time series diagnose process to come up with a list of candidate models, and then the model with the best selection criteria measure (e.g. MAPE) is selected as the winning model. By default only ARIMA and ESM class of models are considered in the diagnose process. You can also include UCM and combined models to be included in the candidate model list. Please note that it is possible that you can come up with a model that beats all the models the automatic diagnose process came up with. The diagnose process only looked at a subset of all possible ARIMA and ESM model classes based on the series characteristics it detected (lags, diffs, cross correlations, etc.). 

Hope this helps.

Alex

View solution in original post

2 REPLIES 2
alexchien
Pyrite | Level 9

Hi Jessica,

Forecast Server uses an automatic time series diagnose process to come up with a list of candidate models, and then the model with the best selection criteria measure (e.g. MAPE) is selected as the winning model. By default only ARIMA and ESM class of models are considered in the diagnose process. You can also include UCM and combined models to be included in the candidate model list. Please note that it is possible that you can come up with a model that beats all the models the automatic diagnose process came up with. The diagnose process only looked at a subset of all possible ARIMA and ESM model classes based on the series characteristics it detected (lags, diffs, cross correlations, etc.). 

Hope this helps.

Alex

jctran123
Calcite | Level 5

Hi Alex,

 

This was very helpful! Thank you for explaining this to me! 

 

Jessica

sas-innovate-2024.png

 

Secure your spot at the must-attend AI and analytics event of 2024: SAS Innovate 2024! Get ready for a jam-packed agenda featuring workshops, super demos, breakout sessions, roundtables, inspiring keynotes and incredible networking events.

 

Register by March 1 to snag the Early Bird rate of just $695! Don't miss out on this exclusive offer. 

 

Register now!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 913 views
  • 1 like
  • 2 in conversation