topic Re: DID in Statistical Procedures

DID

Emily_Chi — Mon, 06 May 2024 06:50:30 GMT

I am currently analyzing the impact of an intervention on medication numbers using difference-in-difference analysis, but I have encountered several challenges.

Following the SAS support instructions, I conducted the difference-in-difference analysis. However, I noticed a discrepancy between my results and SAS's example (Usage Note 61830: Estimating the difference in differences of means).

In the example, the value of 'Mean Estimate' in 'Contrast Estimate Results' is identical to the 'Estimate' in 'Least Squares Means Estimate'. However, in my case, these values were different. I suspect this could be due to my use of the negative binomial distribution with a log link, resulting in exponential values. Consequently, I am unsure whether to rely on the 'Mean Estimate' in 'Contrast Estimate Results' or the 'Estimate' in 'Least Squares Means Estimate', and how to interpret the results."

Contrast Estimate Results

Label	Mean Estimate	Mean Confidence Limits	L'Beta Estimate	Standard Error
diff in diff	1.51	1.49	0.41	0.0051

a*b Least Squares Means

a	b	Estimate	Standard Error	z value	Pr > \|z\|
1	1	0.77	0.00434	178.19	<.0001
1	0	0.03	0.00508	6.5	<.0001
0	1	0.72	0.00408	177.71	<.0001
0	0	0.40	0.00426	93.11	<.0001

Least Squares Means Estimate

Effect	Label	Estimation	Standard Error	z value	Pr > \|z\|
time*hospitalize	diff in diff	0.41	0.00509	81.01	<.0001

Re: DID

sbxkoenk — Mon, 06 May 2024 20:55:05 GMT

This is the same question as posted in the programming board.

Home > Programming > Programming > Difference-in-difference
https://communities.sas.com/t5/SAS-Programming/Difference-in-difference/m-p/927128

Please do not duplicate your question on multiple boards.

Also take the right board. I will move this one to "Statistical Procedures"-board in a minute.

Koen

Re: DID

StatDave — Mon, 06 May 2024 22:20:10 GMT

Reread the text at the beginning of the "Generalized Linear Models with a Non-Identity Link" section - this section, and not the first section on a normal response, applies to your log-linked model. As stated there:

"Because this is not a linear combination of the model parameters or of the LS-means, you cannot use the ESTIMATE or LSMESTIMATE statements to estimate the difference in differences of means. "

Re: DID

Emily_Chi — Tue, 07 May 2024 05:03:46 GMT

Thank you for providing clarification on this issue! It's really helpful for me.

Re: DID

StatDave — Tue, 07 May 2024 15:29:25 GMT

Note that when you use the ESTIMATE statement in PROC GENMOD, the results automatically include a "Mean Estimate" which, in your case, is 1.51. But this is a mean only when the contrast specified in the statement defines one population and not a comparison of populations such as a difference in difference contrast. The Mean estimate just applies the inverse of the link function to the computed contrast and is often meaningless. For the difference in difference contrast (1 -1 -1 1) in a log linked model, the Mean estimate is exp[log(mean_11)-log(mean_10)-log(mean_01)+log(mean_00)] which, when simplified is the ratio of mean ratios rather than the difference of mean differences: (mean_11/mean_10)/(mean_01/mean_00).

Re: DID

Emily_Chi — Wed, 08 May 2024 08:24:24 GMT

If the outcome is not binary, I cannot use logistic regression in DID, right?

The outcome of my study is the number of medications, which is not the binary outcome. The outcome is continuous, however, it is a gamma distribution, so I used a log link to address the right-skew problem. I think that it could not use the DID with normal distribution, is there any suggestion for analysis of gamma distribution outcome in DID? Thank you.

Re: DID

sbxkoenk — Wed, 08 May 2024 08:32:37 GMT

https://communities.sas.com/t5/Statistical-Procedures/Difference-in-difference-for-gamma-distribution/td-p/623102

For difference in difference analysis with non-normal responses, see this note.

Koen

Re: DID

StatDave — Wed, 08 May 2024 20:05:15 GMT

If your response is a count of medications, then it is a discrete, categorical variable which is typically modeled using either the Poisson or negative binomial distribution. The "Generalized Linear Models with a Non-Identity Link" section of the note that you mentioned (61830) deals with the range of generalized linear models which includes many response distributions including Poisson, negative binomial, gamma and others, not just binary response models. The note just uses a binary response model as an example, but the methods discussed in that section apply to the range of models.

Re: DID

Emily_Chi — Fri, 10 May 2024 05:13:44 GMT

Thanks for your response.