topic Re: Comparing predicted probabilities in Statistical Procedures

Comparing predicted probabilities

eajanio — Sun, 08 Sep 2024 18:02:59 GMT

Hello,

I used the lsmeans command with the ilink option to calculate the predicted probability of obtaining the outcome for each combination of categories in my interaction. My question is in regards to interpreting the output. Specifically, can I compare the predicted probabilities using the confidence intervals associated with each value in the "Means" column? And, how does this table differ from the second Differences of txdistanc*AllSVI_ter Least Squares Means table?

proc logistic data="H:\desktop\DataAnalysis" descending;

class txdistancetri1 (ref='1') AllSVI_tert0 (ref='1') /param=glm;

model totdelaybi = AllSVI_tert0 txdistancetri1 AllSVI_tert0*txdistancetri1 ;

lsmeans AllSVI_tert0*txdistancetri1/ ilink diff;

run;

Re: Comparing predicted probabilities

StatDave — Sun, 08 Sep 2024 19:15:14 GMT

The Estimate value in the Differences table is the difference in log odds (logits) and the test is a test of that difference. To directly estimate and test the difference in the predicted probabilities, whose estimates are in the Mean column of the first LSMEANS table, you can use the NLMeans macro as shown in this note.

Re: Comparing predicted probabilities

eajanio — Sun, 08 Sep 2024 19:40:12 GMT

Thank you for your reply. This is helpful. Below is my code and the associated output. Can you please explain how to interpret the table?

proc logistic data="H:\desktop\DataAnalysis" descending;

class txdistancetri1 (ref='1') AllSVI_tert0 (ref='1') /param=glm;

model totdelaybi = AllSVI_tert0 txdistancetri1 AllSVI_tert0*txdistancetri1 ;

lsmeans AllSVI_tert0*txdistancetri1/ ilink e or cl ;

store LogFit;

ods output coef=Coeffs;

run;

%NLMeans(instore=LogFit, coef=Coeffs, link=logit,

title=Differences of A Means)

Re: Comparing predicted probabilities

StatDave — Sun, 08 Sep 2024 21:41:13 GMT

The missing standard errors suggest that you might have had model fitting problems. Post the complete PROC LOGISTIC output or better yet, post your input SAS data set.

Re: Comparing predicted probabilities

eajanio — Sun, 08 Sep 2024 22:01:32 GMT

I see. Here are the notes I received:

NOTE: A newer version of the NLMEANS macro is available at

this location: http://support.sas.com/

NOTE: A newer version of the NLESTIMATE macro is available at

this location: http://support.sas.com/

WARNING: The final Hessian matrix is not positive definite, and therefore the estimated covariance

matrix is not full rank and may be unreliable. The variance of some parameter estimates is

zero or some parameters are linearly related to other parameters.

NOTE: The NLMEANS macro used 1.14 seconds.

Re: Comparing predicted probabilities

StatDave — Mon, 09 Sep 2024 03:47:04 GMT

That is the log not the output. Show all of the tables produced by proc logistic. But it would be better if you attached the data set that proc logistic ran against so that the results can be replicated.