topic Re: conditional lag in SAS Programming

conditional lag

SAS_inquisitive — Tue, 20 Jun 2017 15:15:44 GMT

Hello,

Can someone explain me the lag fuction in terms of 'QUEUE'? Also why conditional lag can give incorrect result?

http://www.howles.com/saspapers/CC33.pdf

Thanks !

Re: conditional lag

Kurt_Bremser — Tue, 20 Jun 2017 15:41:17 GMT

The lag() function works like a FIFO (first-in-first-out) queue. It only gets a value when it is called. Calling it conditionally will result in not all values being fed into the queue, and therefore unwanted results.

Re: conditional lag

SAS_inquisitive — Tue, 20 Jun 2017 17:31:35 GMT

@Kurt_Bremser I wonder if you have an example for this?

Re: conditional lag

Kurt_Bremser — Tue, 20 Jun 2017 18:31:19 GMT

I leave that as an exercise for the reader. It's really simple to devise code that illustrates this.

@SAS_inquisitive wrote:

@Kurt_Bremser I wonder if you have an example for this?

Re: conditional lag

SAS_inquisitive — Tue, 20 Jun 2017 18:55:13 GMT

@Kurt_Bremser Thank you. Looks like this paper has really good examples.

http://www.lexjansen.com/nesug/nesug10/cc/cc22.pdf

Re: conditional lag

SAS_inquisitive — Thu, 22 Jun 2017 19:56:53 GMT

Let's I have a mock data set.

data mock;

input x;

cards;

;

run;

When I execute lag(x), what would be the value in queue 3 or 1? Is there anyway we can see the values in queue?

Thanks !

Re: conditional lag

SAS_inquisitive — Thu, 22 Jun 2017 22:02:25 GMT

so here is my understanding, when x = 1, there is nothing in the queue, hence it returns missing value. When X=2, 1 is in the queue and it returns 1. Similarly when x =3, 2 is in the queue, and it returns a value of 2.

Re: conditional lag

Quentin — Thu, 22 Jun 2017 22:28:21 GMT

Your understanding is correct. I don't think there s a way to see what is inside the queue, other than pushing values into the queue to push them out.

Definitely take the time to play around with conditional lags, to convince yourself that the lag() function works when called conditionally. Far too many people mistakenly think there is a bug in the lag function and that it should never be called conditionally. It works perfectly fine conditionally, you just need to understand how a queue works. e.g., think about what you should expect from:

data _null_;
  set mock;
  if x IN (2,3) then lag=lag(x);
  put x= lag=;
run;

Also worth playing with lags with longer queues, e.g.:

data _null_;
  set mock;
  lag1=lag1(x);
  lag2=lag2(x);
  lag3=lag3(x);
  put (x lag1 lag2 lag3)(=);
run;

Re: conditional lag

Kurt_Bremser — Fri, 23 Jun 2017 06:25:44 GMT

To slightly expand your code and show the problems of a conditional lag, just do this:

data mock;
input x;
cards;
1
2
3
4
5
;
run;

data test;
set mock;
if x ne 3 then x1 = lag(x);
run;

proc print data=test noobs;
run;

The result shows the effect of lag() not being called in obs 3: