topic Re: Are the sample dependent in a matched pair of logistic regression in Statistical Procedures

Are the sample dependent in a matched pair of logistic regression

TomHsiung — Sun, 22 Jun 2025 04:32:30 GMT

This is from Wikipedia. The joint probability of the match pair when Yi1 =1 and Yi2 = 0. Note the denominator, where the P(Yi1 =1 & Yi2 =0), and P(Yi1 =0 & Yi2 =1) are the product of their own probability, respectively. Therefore, my question is, are Yi1 and Yi2 independent or dependent? Looking forward to your opinion.

The joint probability of a pair:

Re: Are the sample dependent in a matched pair of logistic regression

StatDave — Sun, 22 Jun 2025 14:55:36 GMT

If observations are matched then they are not independent. Study data can consist of matched sets of any size, not just pairs, with any number of events observed within each set if the response is binary. There are various analytical methods that can be used for binary response data of this type including conditional logistic regression which is available with the STRATA statement in PROC LOGISTIC. Other possibilities include the Generalized Estimating Equations and Alternating Logistic Regressions using the REPEATED statement in PROC GEE or PROC GENMOD and random effect models using the RANDOM statement in PROC GLIMMIX. A non-model-based approach using stratification is available with the CMH option in PROC FREQ when a multi-way table is specified. See the examples in the documentation for each of these procedures.

Re: Are the sample dependent in a matched pair of logistic regression

TomHsiung — Sat, 28 Jun 2025 11:38:55 GMT

Hello, Dave

Thank you for your feedback. Say, we have event A=1 and B=0. According to the matching condition, we have A + B = 1.

The condition probability of P( A = 1 & B = 0 | A + B = 1) is calculated as P (A = 1 & B = 0) / [P(A = 1 & B = 0) + P (A = 0 & B = 1)]
Please notice the last step, they have:

P (A = 1 & B = 0) = P(A=1)*P(B=0)
P (A = 0 & B = 1) = P(A=0)*P(B=1)

I think the last two formula means A = 1 and B = 0 as well as A = 0 and B = 1 are independent, respectively.

That's why I'm confused about the independence between event A and B.

Re: Are the sample dependent in a matched pair of logistic regression

FreelanceReinh — Wed, 09 Jul 2025 14:25:17 GMT

@TomHsiung wrote:
I think the last two formula means A = 1 and B = 0 as well as A = 0 and B = 1 are independent, respectively.

That's why I'm confused about the independence between event A and B.

Hello @TomHsiung,

I see your point.

My understanding is that the random variables describing the individual responses are independent, hence the products of probabilities in the Wikipedia article you have mentioned. Yet, as a rule, matched pairs are correlated in the following sense: If X, Y denote the responses of a randomly selected matched pair, these random variables X and Y are usually dependent because they tend to have similar response probabilities due to the matching.

Here is a small example with only two matched pairs: (X₁₁, X₁₂) and (X₂₁, X₂₂), each representing, say, (case, control).

Assume independent Bernoulli distributions X₁₁~B(1, 0.94), X₁₂~B(1, 0.91), X₂₁~B(1, 0.22), X₂₂~B(1, 0.29).

Define X:=X_U1, Y:=X_U2 with a random variable U, independent of the X_ij, describing the selection of a pair: P(U=1)=P(U=2)=0.5.

Then we obtain the joint distribution of (X, Y) from calculations like P(X=1, Y=1) = P(U=1)P(X₁₁=1)P(X₁₂=1)+P(U=2)P(X₂₁=1)P(X₂₂=1)=0.4596:

P	X=0	X=1
Y=0	0.2796	0.1204	0.4
Y=1	0.1404	0.4596	0.6
	0.42	0.58	1

Now we see that X and Y are correlated, hence dependent:
Their correlation coefficient is r_X,Y=(0.4596-0.58*0.6)/sqrt(0.58*0.42*0.6*0.4)=0.46155...

Re: Are the sample dependent in a matched pair of logistic regression

TomHsiung — Mon, 21 Jul 2025 13:47:29 GMT

Hi, @FreelanceReinh

Thank you for your response. Hmmm, my bachelor degree is not statistics.

We have:
P (A = 1 & B = 0) = P(A=1)*P(B=0)
P (A = 0 & B = 1) = P(A=0)*P(B=1)

Actually, can we say:
P (A = 1 & B = 1) = P(A=1)*P(B=1)
P (A = 1 & B = 1) = P(A=1)*P(B=1)
for the observations?

If so, I think for each observation, they are independent for the response event.

Re: Are the sample dependent in a matched pair of logistic regression

FreelanceReinh — Mon, 21 Jul 2025 14:16:15 GMT

Yes, this implication is always true for two binary random variables A and B on some probability space. Even either of the two equations

@TomHsiung wrote:
P (A = 1 & B = 0) = P(A=1)*P(B=0)
P (A = 0 & B = 1) = P(A=0)*P(B=1)

alone implies the other and the remaining two combinations

P (A = 1 & B = 1) = P(A=1)*P(B=1)

and P(A=0 & B=0) = P(A=0)*P(B=0),

all of which mean that A and B are independent.

For example, assuming P(A=1 & B=0) = P(A=1)*P(B=0), we obtain

P(A=1 & B=1) = P(A=1) - P(A=1 & B=0) = P(A=1) - P(A=1)*P(B=0) = P(A=1)*(1-P(B=0)) = P(A=1)*P(B=1).