topic Re: How do you impose an 'excepted value' for outliers? in SAS Procedures

How do you impose an 'excepted value' for outliers?

pearson101 — Sat, 16 Jan 2021 14:47:42 GMT

If I have outliers in my variable. How can I program SAS to find those outliers and make them the average of the previous value and the subsequent value? For example,

if malaria cases are 1714 for Feb 2018 I want SAS to take the average between Jan 2018 (200 cases) and March 2018 (47 cases).

Thank you.

Re: How do you impose an 'excepted value' for outliers?

Astounding — Sat, 16 Jan 2021 18:06:57 GMT

Here's a way to average the prior and post values. You still have to decide what makes a value an outlier and incude that logic in the program.

data want;
   merge have have (obs=2 keep=variable rename=(variable=subsequent));
   prior = lag(variable);
   if  /* your logic determines that current VARIABLE value is an outlier */ then do;
      if _n_=1 then capped_value = subsequent;
      else capped_value = mean(subsequent, prior);
   end;
   else capped_value = variable;
run;

Then use CAPPED_VALUE instead of VARIABLE.

Re: How do you impose an 'excepted value' for outliers?

pearson101 — Sat, 16 Jan 2021 19:24:58 GMT

Thank you. Can you please explain what datasets I would put in the 2 'have' part and what 'keep 2 observations' means?

What can be place in the logic if I want the outlier to be +/- 3 SD from mean?

Re: How do you impose an 'excepted value' for outliers?

Astounding — Sat, 16 Jan 2021 22:14:17 GMT

"Have" is the name of the data set that you have that contains all the data.

The obs=2 tells SAS to start reading that data set with the second observation. So one "have" starts at the first observation, and the other "have" reference starts at the second observation, thus getting the subsequent value for your variable.