BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
doudou66
Calcite | Level 5

Dear All

If outlier is identified in the data and is not due to error, what is the common way to do with those outliers? Is Proc Robustreg always the better way to go than simply removing the outliers?

Thank you very much for your input.

1 ACCEPTED SOLUTION

Accepted Solutions
PGStats
Opal | Level 21

Robust regression is just one way to downplay the influence of observations with extreme residuals. You can do it on your own by giving less weight to outlying observations (use the WEIGHT statement) or by removing the observation (equivalent to o weight of zero). If these observations are important in the phenomenon that you are modelling, then it might be better to investigate further. This might leed you to transform your data (e.g. log transformation) or to add extra terms in your model to account for their possible occurence.

Your model is a simplification of reality. It is up to you to decide how much outliers should be accounted for.

PG

PG

View solution in original post

3 REPLIES 3
PGStats
Opal | Level 21

Robust regression is just one way to downplay the influence of observations with extreme residuals. You can do it on your own by giving less weight to outlying observations (use the WEIGHT statement) or by removing the observation (equivalent to o weight of zero). If these observations are important in the phenomenon that you are modelling, then it might be better to investigate further. This might leed you to transform your data (e.g. log transformation) or to add extra terms in your model to account for their possible occurence.

Your model is a simplification of reality. It is up to you to decide how much outliers should be accounted for.

PG

PG
doudou66
Calcite | Level 5

Thank you very much for help.

SteveDenham
Jade | Level 19

I want to echo Perre's thinking, and say: Always be thinking about outliers.  Provided that they are not blunders in recording data, they are the unusual--those cases that your model does NOT explain.  It always bothered me (except in analytical chemistry settings) that the tendency amongst many data analysts was to throw out those observations that make the preconceived model misbehave, rather than follow up on those points and see if there is anything remarkable about them.  To me it would be like a coin collector discarding any coin minted before, say 400 CE, simply because 99.99% of all coins have been minted since that date.  If outlier data are found in a well-controlled and designed study, there is SOMETHING VERY IMPORTANT happening.

Steve Denham

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 1545 views
  • 1 like
  • 3 in conversation