topic Re: Run cross validation for an autoregressive model in SAS Forecasting and Econometrics

Run cross validation for an autoregressive model

LawrenceYu01 — Fri, 22 Jul 2016 16:57:40 GMT

Hello guys,

I would like to know if there is any way to run a cross validaiton estiamte for an autoregressive model.

For instance, I have a model after using glmselect to run cross validation estimates like this:

I also ran autoreg to generate an autoregressive model, like this:

Now I have two more lag terms here, how can I write a code to generate a cross validation estimates with those two lag terms?

Or is there any other way to keep them in my model?

Thank you.

Lawrence

Re: Run cross validation for an autoregressive model

LawrenceYu01 — Sun, 24 Jul 2016 15:00:56 GMT

I think an alternative way is to create lagged varaibles manually and run the regression, but the thing is that how do we create lagged values for error terms?

Thank you.

Re: Run cross validation for an autoregressive model

LawrenceYu01 — Tue, 26 Jul 2016 15:09:47 GMT

Anybody knows how to do it ...?

Re: Run cross validation for an autoregressive model

bbridgerb — Fri, 29 Jul 2016 17:47:59 GMT

The AUTOREG procedure cannot do the cross validation directly. If you wanted to crossvalidate the way GLMSELECT does you would have to split up the sample and invoke PROC AUTOREG multiple times. The AR terms would be handled just like any non autoregressive parameters in the model.

Re: Run cross validation for an autoregressive model

LawrenceYu01 — Fri, 29 Jul 2016 19:51:29 GMT

Thank you for your reply. Could you please elaborate more on how to split up sample and run AUTORET multiple times? I appreciate your time.

Re: Run cross validation for an autoregressive model

bbridgerb — Mon, 08 Aug 2016 15:51:14 GMT

In a data step you need to subsample the data to create the fitting (training) and validation subsamples. In your case you would repeat this process ten times to get random subsamples. The training subsample will be used to fit the model while the validation one will be used to validate it. You can assemble a similar table to the one from GLMSELECT using the AUTOREG results. I am not sure what kind of cross validation you would like to do but you can use the OUTPUT statement in the AUTOREG procedure to get predicted values used in the calculation. You would likely have to append the validation data to the training dataset with the dependent variable missing (trick to exclude these from the estimation but get predictions for them) to get predicted values for them.

Re: Run cross validation for an autoregressive model

LawrenceYu01 — Mon, 08 Aug 2016 19:23:53 GMT

Thank you very much!

Re: Run cross validation for an autoregressive model

gergely_batho — Thu, 11 Aug 2016 08:19:32 GMT

Another convinient way to do this: proc surveyselect reps=10;

Then you can use: proc autoreg ; by replicate;