BookmarkSubscribeRSS Feed
supp
Pyrite | Level 9

Hello SAS Community, I am working on an observational study to determine the impact of a program. My approach is to compare the results of the treatment group to a control group. I thought this would be a good approach because I could control for possible confounding variables by using a one to one match on these variables.

 

After presenting some initial results most of the feedback has been additional variables that should have been controlled for. Is there a way to control for additional variables using the existing control/treatment populations and save my analysis? Or do I just keep collecting more data and constructing new control populations?

 

For example, if I constructed a control group to compare to the treatment group but failed to control for height of an individual and my populations are not balanced on this variable, is there a way to analyze the data control for height? Such that I can reliably extract the impact of the program?

 

I have been learning as I go on this project and I suspect this might be a simple/silly question for more experienced statisticians. I am asking in general to figure out what techniques or procedures I need to learn more about.

3 REPLIES 3
supp
Pyrite | Level 9

Thanks @PGStats , while I did not use PSMATCH to create my control/treatment populations I think I got to a similar place using the gmatch macro. Instead of first calculating a propensity score then using that score for the match, I simply matched on my variables. The results looked good. I was able to create a control population that matched on the variables used.

 

From the PSMATCH documentation, "Provided that the distributions of the variables in the adjusted sample are well balanced between the treated and control groups, the output data set serves as input for a subsequent outcome analysis that incorporates weights or strata or that is based on matched observations. Although the PSMATCH procedure itself does not provide this analysis, many other SAS/STAT procedures can be used for this purpose."

 

Based on this, if I do in fact have a confounding variable this is not balanced between my populations then I think my best approach is to re-make the control population to balance for additional variables. 

 

Also in the documentation I see we can perform a sensitivity analysis to help decide if my results should be negated. I will look into this more.

supp
Pyrite | Level 9

To do a sensitivity analysis on matched pairs it seems we need to know the probability of the individual being in the treatment/control group. How do we know this probability? Would we use a logistic regression to model the likelihood of an individual being in the treatment group using the variables used in the matching?

 

supp_0-1596325545159.png

 

SAS Innovate 2025: Save the Date

 SAS Innovate 2025 is scheduled for May 6-9 in Orlando, FL. Sign up to be first to learn about the agenda and registration!

Save the date!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 886 views
  • 0 likes
  • 2 in conversation