BookmarkSubscribeRSS Feed
☑ This topic is solved. Need further help from the community? Please sign in and ask a new question.
sasalex2024
Fluorite | Level 6

Hi SAS community,

I've noticed that univariate ARIMA models are typically estimated by default using the maximum likelihood method. However, in SAS, the default method is CLS. According to the SAS manual, "Maximum likelihood estimates are more computationally expensive than conditional least squares estimates." SAS offers three options for estimation methods: CS, MLS, and ULS. Generally, which option would be preferable to use if all three methods converge and take the same computation time? Thank you.

1 ACCEPTED SOLUTION

Accepted Solutions
SASCom1
SAS Employee

Hello @sasalex2024 

 

I am not aware of an absolute answer to the question of which estimation method is preferred always, but you may find the following information and/or references helpful to you to decide which method you want to use:

 

(1). In PROC ARIMA documentation you are referencing, the following statement follows:

 

SAS Help Center: Estimation Details

 

...Maximum likelihood estimates are more expensive to compute than the conditional least squares estimates; however, they may be preferable in some cases (Ansley and Newbold 1980; Davidson 1981).

 

You may want to check the two references mentioned above to see the cases discussed where ML is preferable. 

 

 

(2). SAS for Forecasting Time Series, third edition, by Brocklebank, Dickey, and Choi:

"Although CLS, ULS, and ML should give similar results for reasonably large data sets, studies comparing the three methods indicate that ML is the most accurate."

 

(3). Forecasting with Univariate Box-Jenkins Models, by Pankratz:

"Box and Jenkins (ref.) favor estimates chosen according to the maximum likelihood criterion. Mathematical statisticians frequently prefer the ML approach to estimation problems because the resulting estimates often have attractive statistical properties. ....."

"However, finding exact ML estimates of ARIMA models can be cumbersome and may require relatively large amounts of computer time. For this reason, Box and Jenkins suggest using the least-squares(LS) criterion. ....."

 

 

 

I hope this helps.

 

Wen

 

View solution in original post

1 REPLY 1
SASCom1
SAS Employee

Hello @sasalex2024 

 

I am not aware of an absolute answer to the question of which estimation method is preferred always, but you may find the following information and/or references helpful to you to decide which method you want to use:

 

(1). In PROC ARIMA documentation you are referencing, the following statement follows:

 

SAS Help Center: Estimation Details

 

...Maximum likelihood estimates are more expensive to compute than the conditional least squares estimates; however, they may be preferable in some cases (Ansley and Newbold 1980; Davidson 1981).

 

You may want to check the two references mentioned above to see the cases discussed where ML is preferable. 

 

 

(2). SAS for Forecasting Time Series, third edition, by Brocklebank, Dickey, and Choi:

"Although CLS, ULS, and ML should give similar results for reasonably large data sets, studies comparing the three methods indicate that ML is the most accurate."

 

(3). Forecasting with Univariate Box-Jenkins Models, by Pankratz:

"Box and Jenkins (ref.) favor estimates chosen according to the maximum likelihood criterion. Mathematical statisticians frequently prefer the ML approach to estimation problems because the resulting estimates often have attractive statistical properties. ....."

"However, finding exact ML estimates of ARIMA models can be cumbersome and may require relatively large amounts of computer time. For this reason, Box and Jenkins suggest using the least-squares(LS) criterion. ....."

 

 

 

I hope this helps.

 

Wen

 

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!

Submit your idea!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 644 views
  • 1 like
  • 2 in conversation