topic Re: Pooling frequencies after multiple imputation in SAS in Statistical Procedures

topic Re: Pooling frequencies after multiple imputation in SAS in Statistical Procedures https://communities.sas.com/t5/Statistical-Procedures/Pooling-frequencies-after-multiple-imputation-in-SAS/m-p/693170#M33448 <P>In order to combine point estimates for any statistic in a multiple imputation setting, you must have a standard error associated with that point estimate.  <SPAN class="cs53F207AF">The issue with using Proc FREQ is that it does not give you standard errors for either the percentages or the frequencies.  My suggestion would be to use Proc SURVEYFREQ instead and combine the results similar to the approach in the attached example.  Note that you must use the WTFREQ option on the TABLES statement even if you do not have a WEIGHT statement in order to get a standard error.</SPAN></P> <P> </P> <P>/* Generate Data */</P> <P>proc format;<BR />value ResponseCode 1 = 'Very Unsatisfied'<BR />2 = 'Unsatisfied'<BR />3 = 'Neutral'<BR />4 = 'Satisfied'<BR />5 = 'Very Satisfied';<BR />run;</P> <P>proc format;<BR />value UserCode 1 = 'New Customer'<BR />0 = 'Renewal Customer';<BR />run;</P> <P>proc format;<BR />value SchoolCode 1 = 'Middle School'<BR />2 = 'High School';<BR />run;</P> <P>proc format;<BR />value DeptCode 0 = 'Faculty'<BR />1 = 'Admin/Guidance';<BR />run;</P> <P>data SIS_Survey;<BR />format Response ResponseCode.;<BR />format NewUser UserCode.;<BR />format SchoolType SchoolCode.;<BR />format Department DeptCode.;<BR />do _imputation_=1 to 2;<BR />drop j;<BR />retain seed1 111;<BR />retain seed2 222;<BR />retain seed3 333;</P> <P>State = 'GA';</P> <P>NewUser = 1;<BR />do School=1 to 71;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; end;<BR />end;</P> <P>NewUser = 0;<BR />do School=72 to 134;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; end;<BR />end;</P> <P>State = 'NC';</P> <P>NewUser = 1;<BR />do School = 135 to 218;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; output;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; output;<BR />end;</P> <P>NewUser = 0;<BR />do School = 219 to 274;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; output;<BR />end;</P> <P>State = 'SC';</P> <P>NewUser = 1;<BR />do School = 275 to 328;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; output;<BR />end;</P> <P>NewUser = 0;<BR />do School = 329 to 370;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; output;<BR />end;<BR />end;<BR />run;<BR />/*Run SURVEYFREQ by _IMPUTATION_ assuming the MI step is already done*/<BR />proc surveyfreq data=SIS_Survey;<BR />by _imputation_;<BR />tables Response*schooltype/wtfreq;<BR />ods output CrossTabs=mi_ctab;<BR />run;</P> <P><BR />/*Sort the data by the TABLES variables which is called RESPONSE here*/<BR />proc sort data=mi_ctab;<BR />by response schooltype _imputation_;<BR />run;</P> <P>/*Run MIANALYZE with STDERR option*/<BR />proc mianalyze data=mi_ctab;<BR />by response schooltype;*this would be the TABLES variable;<BR />modeleffects wgtfreq;<BR />stderr stdDev;<BR />title 'Results for Weighted Frequency';<BR />run;</P> <P> </P> <P><SPAN class="cs53F207AF"> </SPAN></P> <P class="cs95E872D0"><SPAN class="cs53F207AF"> </SPAN></P> Wed, 21 Oct 2020 13:21:25 GMT SAS_Rob 2020-10-21T13:21:25Z Pooling frequencies after multiple imputation in SAS https://communities.sas.com/t5/Statistical-Procedures/Pooling-frequencies-after-multiple-imputation-in-SAS/m-p/693098#M33442 <P>Hi,</P><P> </P><P>I have imputed data using multiple imputation using PROC MI in SAS, generating n imputed datasets. Now, I would like to report a baseline table with imputed values. However, I cannot find the right SAS code to do so. I've used PROC FREQ using a BY _ imputation _ statement, to get n baseline tables. I want to combine these n tables into just one, with pooled frequencies for every category of the covariates.</P><P>Apparently this is fairly easy in SPSS but not in SAS. I found some topics suggesting PROC MIANALYZE, which might be a solution, but the examples I found only considered estimates in for example regression models. Does someone have a suggestion on how to combine the frequencies from n imputed datasets into one pooled baseline table?</P><P> </P><P>Many thanks!</P> Wed, 21 Oct 2020 09:47:47 GMT https://communities.sas.com/t5/Statistical-Procedures/Pooling-frequencies-after-multiple-imputation-in-SAS/m-p/693098#M33442 LisavH 2020-10-21T09:47:47Z Re: Pooling frequencies after multiple imputation in SAS https://communities.sas.com/t5/Statistical-Procedures/Pooling-frequencies-after-multiple-imputation-in-SAS/m-p/693170#M33448 <P>In order to combine point estimates for any statistic in a multiple imputation setting, you must have a standard error associated with that point estimate.  <SPAN class="cs53F207AF">The issue with using Proc FREQ is that it does not give you standard errors for either the percentages or the frequencies.  My suggestion would be to use Proc SURVEYFREQ instead and combine the results similar to the approach in the attached example.  Note that you must use the WTFREQ option on the TABLES statement even if you do not have a WEIGHT statement in order to get a standard error.</SPAN></P> <P> </P> <P>/* Generate Data */</P> <P>proc format;<BR />value ResponseCode 1 = 'Very Unsatisfied'<BR />2 = 'Unsatisfied'<BR />3 = 'Neutral'<BR />4 = 'Satisfied'<BR />5 = 'Very Satisfied';<BR />run;</P> <P>proc format;<BR />value UserCode 1 = 'New Customer'<BR />0 = 'Renewal Customer';<BR />run;</P> <P>proc format;<BR />value SchoolCode 1 = 'Middle School'<BR />2 = 'High School';<BR />run;</P> <P>proc format;<BR />value DeptCode 0 = 'Faculty'<BR />1 = 'Admin/Guidance';<BR />run;</P> <P>data SIS_Survey;<BR />format Response ResponseCode.;<BR />format NewUser UserCode.;<BR />format SchoolType SchoolCode.;<BR />format Department DeptCode.;<BR />do _imputation_=1 to 2;<BR />drop j;<BR />retain seed1 111;<BR />retain seed2 222;<BR />retain seed3 333;</P> <P>State = 'GA';</P> <P>NewUser = 1;<BR />do School=1 to 71;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; end;<BR />end;</P> <P>NewUser = 0;<BR />do School=72 to 134;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; end;<BR />end;</P> <P>State = 'NC';</P> <P>NewUser = 1;<BR />do School = 135 to 218;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; output;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; output;<BR />end;</P> <P>NewUser = 0;<BR />do School = 219 to 274;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; output;<BR />end;</P> <P>State = 'SC';</P> <P>NewUser = 1;<BR />do School = 275 to 328;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; output;<BR />end;</P> <P>NewUser = 0;<BR />do School = 329 to 370;</P> <P>call rantbl( seed1, .45, .55, SchoolType );</P> <P>Department = 0;<BR />call rannor( seed3, x );<BR />SamplingWeight = 25 + x * 2;<BR />do j=1 to 2;<BR />if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .16, .21, .30, .24, .09, Response);<BR />else<BR />call rantbl( seed2, .18, .23, .30, .22, .07, Response);<BR />output; end;<BR />output;</P> <P>Department = 1;<BR />call rannor( seed3, x );<BR />SamplingWeight = 15 + x * 1.5;</P> <P>if ( SchoolType = 1 ) then<BR />call rantbl( seed2, .10, .15, .33, .28, .14, Response );<BR />else<BR />call rantbl( seed2, .13, .20, .30, .26, .11, Response);<BR />output; output;<BR />end;<BR />end;<BR />run;<BR />/*Run SURVEYFREQ by _IMPUTATION_ assuming the MI step is already done*/<BR />proc surveyfreq data=SIS_Survey;<BR />by _imputation_;<BR />tables Response*schooltype/wtfreq;<BR />ods output CrossTabs=mi_ctab;<BR />run;</P> <P><BR />/*Sort the data by the TABLES variables which is called RESPONSE here*/<BR />proc sort data=mi_ctab;<BR />by response schooltype _imputation_;<BR />run;</P> <P>/*Run MIANALYZE with STDERR option*/<BR />proc mianalyze data=mi_ctab;<BR />by response schooltype;*this would be the TABLES variable;<BR />modeleffects wgtfreq;<BR />stderr stdDev;<BR />title 'Results for Weighted Frequency';<BR />run;</P> <P> </P> <P><SPAN class="cs53F207AF"> </SPAN></P> <P class="cs95E872D0"><SPAN class="cs53F207AF"> </SPAN></P> Wed, 21 Oct 2020 13:21:25 GMT https://communities.sas.com/t5/Statistical-Procedures/Pooling-frequencies-after-multiple-imputation-in-SAS/m-p/693170#M33448 SAS_Rob 2020-10-21T13:21:25Z Re: Pooling frequencies after multiple imputation in SAS https://communities.sas.com/t5/Statistical-Procedures/Pooling-frequencies-after-multiple-imputation-in-SAS/m-p/693254#M33450 <P>Hi SAS_Rob,</P><P> </P><P>Thank you for your reply.  I had found this SAS-code earlier on in my search but somehow the code did not work then. But I tried the code again and now it works! So thank you very much! </P><P> </P><P>I realized I was close to another solution as well: the weighted frequencies of PROC MIANALYZE are the same as when performing PROC UNIVARIATE and dividing the frequency counts by the <EM>n</EM> imputations. Some example coding with treatment being binary (no, yes) and gender also being binary (male, female):</P><P> </P><PRE><CODE class=" language-sas">*To obtain frequencies per category of the outcome variable; proc univariate data=mi_data freq; class treatment; *To obtain the cumulative frequency omit this line; var gender; run;</CODE></PRE><P> </P> Wed, 21 Oct 2020 17:10:13 GMT https://communities.sas.com/t5/Statistical-Procedures/Pooling-frequencies-after-multiple-imputation-in-SAS/m-p/693254#M33450 LisavH 2020-10-21T17:10:13Z