topic Re: Sensitivity analysis varying misclassification of predictor in SAS Programming

Sensitivity analysis varying misclassification of predictor

mnayan — Sun, 23 Aug 2020 16:24:29 GMT

Hi,

I am running a Cox proportional hazard model evaluating the association of a binary predictor x on outcome Y. My objective is to apply varying sensitivity/specificity definitions of x to account for potential misclassification.

To do this, I would like to randomly select a pre-specified sample size from the population and change their value for x. I would like to obtain a hazard ratio in this hypothetical population. I would then like to repeat this process several hundred/thousand times to obtain an average.

Below is the code that will accomplish this task once. I need help with a macro to have this process repeated several hundred/thousand times and obtain an average from those simulations. Any help is very much appreciated!

data new;

set data_original;

x_new=x;

ran=ranuni(); /* random number between 0 and 1 */

if ran<=0.1 and x=0 then x_new=1; /* if random number <= 0.1 (misclassification probability) and original x. = no, then new x. = yes */

run;

proc phreg data = new ….

….

run;

Re: Sensitivity analysis varying misclassification of predictor

PGStats — Sun, 23 Aug 2020 17:23:48 GMT

I would do this simulation like this :

data new;                                                                                     
call streaminit(869768);
set data_original;                  
do rep = 1 to 1000;
        /* 10 % of the x = 0 are changed to x = 1 */
	if  rand("BERNOULLI", 0.1)  and x = 0 then x_new = 1;
	else x_new = x;
	output;
	end;
run;

proc sort data=new; by rep; run;

proc phreg data = new outest = newEstimates ...;
by rep;
...;

Re: Sensitivity analysis varying misclassification of predictor

FreelanceReinh — Sun, 23 Aug 2020 20:09:03 GMT

Hi @mnayan and welcome to the SAS Support Communities!

I second PG's approach. See also the 2018 post Re: Simulation and outputs and the two blog articles linked therein for additional tips and background information as to why BY-group processing in the analysis procedure is more efficient than the macro loop you envisioned.

Re: Sensitivity analysis varying misclassification of predictor

mnayan — Tue, 25 Aug 2020 20:23:45 GMT

This worked well, thank you so much!

I have one question regarding the confidence intervals of the simulation models. Have these taken into account the repeated nature of the data or are they inappropriately narrow and need further adjustment? If the latter, what method would you suggest? Thank you again in advance.

Re: Sensitivity analysis varying misclassification of predictor

mnayan — Tue, 25 Aug 2020 20:24:13 GMT

Thanks, much appreciated!

Re: Sensitivity analysis varying misclassification of predictor

PGStats — Wed, 26 Aug 2020 02:43:25 GMT

There have been countless papers written about this. Search "bootstrap confidence intervals" in your favorite search engine. The short story is that for most estimators the raw bootstrap confidence interval is pretty good. It is in fact used in many SAS procedures, without correction.

Re: Sensitivity analysis varying misclassification of predictor

mnayan — Wed, 26 Aug 2020 12:23:58 GMT

Thank you again for your comprehensive help!