topic p-value for CMH in Statistical Procedures

p-value for CMH

HappySASUE — Wed, 27 Apr 2022 17:22:26 GMT

Is there a SAS procedure to calculate p-value for Mantel-Haenszel Stratum Weighted Method for risk difference in stratified samples? It provided the CI but I can't find p-value for this test.

SAS code I used is

ods output CommonPdiff=CommonPdiff ;

proc freq data = resp order=data;

tables stratum1*stratum2*trt01pn*resp/riskdiff(common) ;

run;

I can't find option from

https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.4/statug/statug_freq_details.htm

Many thanks

Re: p-value for CMH

StatDave — Wed, 27 Apr 2022 20:19:41 GMT

You can do this by taking a model-based approach. Fit a logistic model that includes your treatment variable and your stratifying variables and include an LSMEANS statement with the DIFF option to compare the treatments. For example, assuming that your binary response variable is Y with values 0 and 1, where 1 represents the event of interest:

  proc logistic;
         class trt strat1 strat2 / param=glm;
         model y(event="1") = trt strat1 strat2;
         lsmeans trt / ilink diff cl;
         run;

You might also want to look at the discussion in this note which is more important when you want to estimate as well as test the risk difference. That note shows how it can be estimated as either the marginal effect of treatment or as a difference of LS-means.

Re: p-value for CMH

Ksharp — Thu, 28 Apr 2022 13:17:42 GMT

Try add CMH option in TABLE.

Re: p-value for CMH

HappySASUE — Fri, 29 Apr 2022 13:00:16 GMT

Thanks.

There are 3 p-values, which one I should use?

Re: p-value for CMH

Ksharp — Fri, 29 Apr 2022 13:39:05 GMT

This three P value correspond to three Hypothesis .
It look like trt01pn and resp have correlation/association after adjusting MUTCAT and HGBCAT .
But these three Hypothesis has nothing to do with RISK . the second statistic is saying the two treat(trt01pn) has different response(resp) . But is more like ANOVA not like RISK .

Or could you also try RELRISK option ?

Re: p-value for CMH

HappySASUE — Fri, 29 Apr 2022 16:11:46 GMT

Hi Ksharp,

Thank you for your patience and help. I added the option, but still no p-value. It is very strange no p-value but CI for MH test.

ods output CommonPdiff=CommonPdiff CMH=cmhpval ;
proc freq data = resp order=data;
tables mutcat*hgbcat*trt01pn*resp/riskdiff(common) cmh RELRISK ;
run;

Re: p-value for CMH

StatDave — Fri, 29 Apr 2022 16:47:19 GMT

If you don't want to take the model-based approach I mentioned earlier, then you can use the COMMONRISKDIFF(TEST) option in PROC FREQ. If you want to test the risk difference, then you don't want the RELRISK option which gives the ratio of risks, not the difference.

Re: p-value for CMH

HappySASUE — Fri, 29 Apr 2022 17:13:54 GMT

Thanks.

Does proc logistic also create the risk difference p value?

Best,

Re: p-value for CMH

StatDave — Fri, 29 Apr 2022 17:19:21 GMT

Yes, the DIFF option in the LSMEANS statement gives a p-value for the difference. The downside with the model-based approach is that you might encounter problems fitting the model particularly if the data are made sparse by the model specification.

Re: p-value for CMH

Ksharp — Sat, 30 Apr 2022 10:18:52 GMT

Or you could check CI ?
For RISKDIFF ,check if CI contains 0 .
For RELRISK ,check if CI contains 1 .

Re: p-value for CMH

HappySASUE — Mon, 02 May 2022 12:44:57 GMT

I had already used logistic regression, need this more sensitivity analysis.