BookmarkSubscribeRSS Feed
JulianLB
Calcite | Level 5

Holdout MAPE is smaller than MAPE. How should I interpret that?

 

How holdout MAPE is calculated?

1 REPLY 1
udo_sas
SAS Employee

Hello -

This discussion: https://communities.sas.com/t5/Forecasting-and-Econometrics/out-of-sample-range-and-holdout-sample/m... might be of interest.

 

To answer your questions: the MAPE calculations only differ in the data which is considered. If your hold out MAPE is smaller than your fit MAPE this can indicate that your model seems to perform better on data which was not used for parameter estimation, which is a good thing typically. But you may want to verify this behaviour by adding out of sample data.

 

Thanks,

Udo

 

PS: http://support.sas.com/documentation/cdl/en/etsug/68148/HTML/default/viewer.htm#etsug_tffordet_sect0...

sas-innovate-2024.png

 

Secure your spot at the must-attend AI and analytics event of 2024: SAS Innovate 2024! Get ready for a jam-packed agenda featuring workshops, super demos, breakout sessions, roundtables, inspiring keynotes and incredible networking events.

 

Register by March 1 to snag the Early Bird rate of just $695! Don't miss out on this exclusive offer. 

 

Register now!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 1095 views
  • 0 likes
  • 2 in conversation